Jan 26 19:02:50.313790 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:02:50.313790 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d331d975-5d80-4d54-9706-573347b45d66]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:02:50.314411 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:02:50.326581 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:02:50.327141 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aff73ad-aae6-4e98-9679-98251c5af9c9]: (4, ('tcp: [5] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:02:50.327594 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 (non-flash) Jan 26 19:02:50.327594 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:02:50.327779 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsi session list stdout=tcp: [5] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 (non-flash) Jan 26 19:02:50.327779 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:02:50.328323 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Resulting device map defaultdict(. at 0x7fd76dca6020>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971'): ({'sda'}, set())}) {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:02:50.328852 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Removing single pathed devices sda {{(pid=189076) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:02:50.331572 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:02:50.340790 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:02:50.340790 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[2c437578-9df7-4302-a1ee-52c3f7d8aaa8]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:02:50.340790 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:02:50.340790 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:02:50.340790 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:02:50.340790 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:02:50.340790 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:02:50.340790 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:02:50.340790 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:02:50.340790 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:02:50.340790 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:02:50.340790 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:02:50.340790 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:02:50.340790 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:02:50.340790 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:02:50.340790 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:02:50.340790 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:02:50.340790 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:02:50.340790 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:02:50.340790 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:02:50.340790 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:02:50.340790 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:02:50.340790 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:02:50.342189 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c437578-9df7-4302-a1ee-52c3f7d8aaa8]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:02:50.342633 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Flushing IO for device /dev/sda {{(pid=189076) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:02:50.344662 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sda {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:02:50.354966 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sda" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:02:50.355485 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15995fe-6761-4981-8d24-ccdf91d6e2d3]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:02:50.355731 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Remove SCSI device /dev/sda with /sys/block/sda/device/delete {{(pid=189076) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:02:50.356661 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sda/device/delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:02:50.404675 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sda/device/delete" returned: 0 in 0.048s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:02:50.404864 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fb2d94-9fe1-4539-9ab6-37a22088cfee]: (4, ('1', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:02:50.405228 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Checking to see if SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:02:50.405536 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:02:50.405807 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971')] {{(pid=189076) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:02:50.406989 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:02:50.409014 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:02:50.418036 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:02:50.419755 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:02:50.419755 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f348621-ca9e-4f99-9923-97e02358c78c]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:02:50.419755 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:02:50.420412 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --logout {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:02:50.422530 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-38b84904-33b1-4dcb-b9bf-e8e9280e119b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:02:50.422693 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-38b84904-33b1-4dcb-b9bf-e8e9280e119b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:02:50.423137 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-38b84904-33b1-4dcb-b9bf-e8e9280e119b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:02:50.423378 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-38b84904-33b1-4dcb-b9bf-e8e9280e119b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:02:50.423642 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-38b84904-33b1-4dcb-b9bf-e8e9280e119b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:02:50.423914 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-38b84904-33b1-4dcb-b9bf-e8e9280e119b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:02:50.448543 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --logout" returned: 0 in 0.028s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:02:50.448689 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18d9261-e29a-42d0-9bb2-5f89dc4a9d8a]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971, portal: 38.102.83.18,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:02:50.449090 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971, portal: 38.102.83.18,3260] Jan 26 19:02:50.449090 np0005596550.novalocal nova-compute[189076]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971, portal: 38.102.83.18,3260] successful. Jan 26 19:02:50.449090 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:02:50.450154 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --op delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:02:50.458430 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --op delete" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:02:50.459267 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[7886692a-8922-4702-bab3-720043d2a6cb]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:02:50.462977 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:02:50.462977 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.186s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:02:50.462977 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] <== disconnect_volume: return (186ms) None {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:02:50.462977 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Disconnected iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jan 26 19:02:50.469678 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] skipping disk /dev/sda (vda) as it is a volume {{(pid=189076) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12209}} Jan 26 19:02:50.469950 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c61cafe4-53dc-4f97-95ce-7920f42bc548_resize/disk.config /opt/stack/data/nova/instances/c61cafe4-53dc-4f97-95ce-7920f42bc548/disk.config {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:02:50.485620 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] CMD "cp -r /opt/stack/data/nova/instances/c61cafe4-53dc-4f97-95ce-7920f42bc548_resize/disk.config /opt/stack/data/nova/instances/c61cafe4-53dc-4f97-95ce-7920f42bc548/disk.config" returned: 0 in 0.015s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:02:50.528107 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:02:50.727831 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Successfully created port: 7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:02:50.922331 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:02:50.929877 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-38b84904-33b1-4dcb-b9bf-e8e9280e119b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Took 10.72 seconds to spawn the instance on the hypervisor. Jan 26 19:02:50.930124 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-38b84904-33b1-4dcb-b9bf-e8e9280e119b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:02:51.033680 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:02:51.180582 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Successfully updated port: 7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:02:51.325912 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-dde41b02-b51d-4bef-8a81-00be4ebe477b req-b279091f-e933-4e0c-b7b2-97b43214932f service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Received event network-changed-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:02:51.325912 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-dde41b02-b51d-4bef-8a81-00be4ebe477b req-b279091f-e933-4e0c-b7b2-97b43214932f service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Refreshing instance network info cache due to event network-changed-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:02:51.325912 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-dde41b02-b51d-4bef-8a81-00be4ebe477b req-b279091f-e933-4e0c-b7b2-97b43214932f service nova] Acquiring lock "refresh_cache-ca9a34ab-50c7-4278-b247-c7a7baeb5968" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:02:51.326024 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-dde41b02-b51d-4bef-8a81-00be4ebe477b req-b279091f-e933-4e0c-b7b2-97b43214932f service nova] Acquired lock "refresh_cache-ca9a34ab-50c7-4278-b247-c7a7baeb5968" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:02:51.326817 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-dde41b02-b51d-4bef-8a81-00be4ebe477b req-b279091f-e933-4e0c-b7b2-97b43214932f service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Refreshing network info cache for port 7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:02:51.442495 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-38b84904-33b1-4dcb-b9bf-e8e9280e119b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Took 15.64 seconds to build instance. Jan 26 19:02:51.683399 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "refresh_cache-ca9a34ab-50c7-4278-b247-c7a7baeb5968" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:02:51.832851 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-dde41b02-b51d-4bef-8a81-00be4ebe477b req-b279091f-e933-4e0c-b7b2-97b43214932f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:02:51.888197 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:02:51.945428 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-38b84904-33b1-4dcb-b9bf-e8e9280e119b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "7c928a35-c5a7-45e1-9e9b-9ea987610ad5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.157s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:02:51.970308 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-da25f3dc-8875-4195-8dc4-715c17d109ca req-1a012bc0-d08b-4046-abb7-05c29d286ec0 service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Received event network-vif-plugged-945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:02:51.970518 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-da25f3dc-8875-4195-8dc4-715c17d109ca req-1a012bc0-d08b-4046-abb7-05c29d286ec0 service nova] Acquiring lock "7c928a35-c5a7-45e1-9e9b-9ea987610ad5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:02:51.970721 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-da25f3dc-8875-4195-8dc4-715c17d109ca req-1a012bc0-d08b-4046-abb7-05c29d286ec0 service nova] Lock "7c928a35-c5a7-45e1-9e9b-9ea987610ad5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:02:51.970981 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-da25f3dc-8875-4195-8dc4-715c17d109ca req-1a012bc0-d08b-4046-abb7-05c29d286ec0 service nova] Lock "7c928a35-c5a7-45e1-9e9b-9ea987610ad5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:02:51.971148 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-da25f3dc-8875-4195-8dc4-715c17d109ca req-1a012bc0-d08b-4046-abb7-05c29d286ec0 service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] No waiting events found dispatching network-vif-plugged-945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:02:51.971304 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-da25f3dc-8875-4195-8dc4-715c17d109ca req-1a012bc0-d08b-4046-abb7-05c29d286ec0 service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Received unexpected event network-vif-plugged-945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97 for instance with vm_state active and task_state None. Jan 26 19:02:51.971471 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-da25f3dc-8875-4195-8dc4-715c17d109ca req-1a012bc0-d08b-4046-abb7-05c29d286ec0 service nova] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Received event network-vif-unplugged-36f759b4-c422-4e36-890d-adda38033305 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:02:51.972177 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-da25f3dc-8875-4195-8dc4-715c17d109ca req-1a012bc0-d08b-4046-abb7-05c29d286ec0 service nova] Acquiring lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:02:51.972177 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-da25f3dc-8875-4195-8dc4-715c17d109ca req-1a012bc0-d08b-4046-abb7-05c29d286ec0 service nova] Lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:02:51.972177 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-da25f3dc-8875-4195-8dc4-715c17d109ca req-1a012bc0-d08b-4046-abb7-05c29d286ec0 service nova] Lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:02:51.972177 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-da25f3dc-8875-4195-8dc4-715c17d109ca req-1a012bc0-d08b-4046-abb7-05c29d286ec0 service nova] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] No waiting events found dispatching network-vif-unplugged-36f759b4-c422-4e36-890d-adda38033305 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:02:51.972323 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-da25f3dc-8875-4195-8dc4-715c17d109ca req-1a012bc0-d08b-4046-abb7-05c29d286ec0 service nova] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Received unexpected event network-vif-unplugged-36f759b4-c422-4e36-890d-adda38033305 for instance with vm_state active and task_state resize_migrating. Jan 26 19:02:51.972391 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-da25f3dc-8875-4195-8dc4-715c17d109ca req-1a012bc0-d08b-4046-abb7-05c29d286ec0 service nova] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Received event network-vif-unplugged-36f759b4-c422-4e36-890d-adda38033305 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:02:51.972535 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-da25f3dc-8875-4195-8dc4-715c17d109ca req-1a012bc0-d08b-4046-abb7-05c29d286ec0 service nova] Acquiring lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:02:51.972697 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-da25f3dc-8875-4195-8dc4-715c17d109ca req-1a012bc0-d08b-4046-abb7-05c29d286ec0 service nova] Lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:02:51.972863 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-da25f3dc-8875-4195-8dc4-715c17d109ca req-1a012bc0-d08b-4046-abb7-05c29d286ec0 service nova] Lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:02:51.973015 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-da25f3dc-8875-4195-8dc4-715c17d109ca req-1a012bc0-d08b-4046-abb7-05c29d286ec0 service nova] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] No waiting events found dispatching network-vif-unplugged-36f759b4-c422-4e36-890d-adda38033305 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:02:51.973169 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-da25f3dc-8875-4195-8dc4-715c17d109ca req-1a012bc0-d08b-4046-abb7-05c29d286ec0 service nova] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Received unexpected event network-vif-unplugged-36f759b4-c422-4e36-890d-adda38033305 for instance with vm_state active and task_state resize_migrating. Jan 26 19:02:52.049584 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:02:52.050439 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:02:52.050667 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Creating image(s) Jan 26 19:02:52.051081 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:02:52.051256 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "/opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:02:52.051730 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "/opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:02:52.052199 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:02:52.055465 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:02:52.056438 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:02:52.133955 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-dde41b02-b51d-4bef-8a81-00be4ebe477b req-b279091f-e933-4e0c-b7b2-97b43214932f service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:02:52.148934 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.092s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:02:52.149141 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:02:52.149564 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:02:52.149964 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:02:52.153263 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:02:52.153570 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:02:52.234179 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.080s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:02:52.234448 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:02:52.252525 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-dde41b02-b51d-4bef-8a81-00be4ebe477b req-b279091f-e933-4e0c-b7b2-97b43214932f service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:02:52.262198 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk 1073741824" returned: 0 in 0.028s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:02:52.262497 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.113s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:02:52.262744 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:02:52.374970 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.112s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:02:52.375219 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:02:52.375508 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:02:52.497390 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:02:52.497689 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Cannot resize image /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:02:52.497997 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:02:52.498163 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Ensure instance console log exists: /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:02:52.498452 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:02:52.498656 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:02:52.498819 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:02:52.650636 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:02:52.651172 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:02:52.722512 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Port 36f759b4-c422-4e36-890d-adda38033305 binding to destination host np0005596550.novalocal is already ACTIVE {{(pid=189076) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jan 26 19:02:52.755075 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-dde41b02-b51d-4bef-8a81-00be4ebe477b req-b279091f-e933-4e0c-b7b2-97b43214932f service nova] Releasing lock "refresh_cache-ca9a34ab-50c7-4278-b247-c7a7baeb5968" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:02:52.755548 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquired lock "refresh_cache-ca9a34ab-50c7-4278-b247-c7a7baeb5968" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:02:52.755756 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:02:53.323260 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:02:53.465573 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:02:53.602119 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Updating instance_info_cache with network_info: [{"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:02:53.766714 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Acquiring lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:02:53.766986 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:02:53.767252 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:02:54.025162 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d25b487d-8f35-475e-a34e-0d04aefa763d req-f47ca9ea-430b-4cdf-af66-3139f7bbba96 service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Received event network-changed-945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:02:54.025552 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d25b487d-8f35-475e-a34e-0d04aefa763d req-f47ca9ea-430b-4cdf-af66-3139f7bbba96 service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Refreshing instance network info cache due to event network-changed-945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:02:54.026345 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d25b487d-8f35-475e-a34e-0d04aefa763d req-f47ca9ea-430b-4cdf-af66-3139f7bbba96 service nova] Acquiring lock "refresh_cache-7c928a35-c5a7-45e1-9e9b-9ea987610ad5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:02:54.026660 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d25b487d-8f35-475e-a34e-0d04aefa763d req-f47ca9ea-430b-4cdf-af66-3139f7bbba96 service nova] Acquired lock "refresh_cache-7c928a35-c5a7-45e1-9e9b-9ea987610ad5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:02:54.027029 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-d25b487d-8f35-475e-a34e-0d04aefa763d req-f47ca9ea-430b-4cdf-af66-3139f7bbba96 service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Refreshing network info cache for port 945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:02:54.105184 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Releasing lock "refresh_cache-ca9a34ab-50c7-4278-b247-c7a7baeb5968" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:02:54.105566 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Instance network_info: |[{"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:02:54.107383 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Start _get_guest_xml network_info=[{"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:02:54.111405 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:02:54.112622 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-612125545', uuid='ca9a34ab-50c7-4278-b247-c7a7baeb5968'), owner=OwnerMeta(userid='8369268788c24337ade1739d948c300a', username='tempest-ServerActionsTestOtherB-1262198412-project-member', projectid='8428b9d1e48c42f690612bf1e012ec42', projectname='tempest-ServerActionsTestOtherB-1262198412'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472174.112242) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:02:54.113990 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:02:54.114586 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:02:54.115476 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:02:54.115865 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:02:54.116891 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:02:54.117163 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:02:54.117521 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:02:54.117648 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:02:54.117799 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:02:54.117924 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:02:54.118041 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:02:54.118290 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:02:54.118488 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:02:54.118630 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:02:54.118793 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:02:54.118946 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:02:54.122620 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-612125545',display_name='tempest-ServerActionsTestOtherB-server-612125545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-612125545',id=63,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK72/fZgFXc8Nm23qFp5bqxu5uQWjdqvi6tf0S8eHH5LAOejrjAG2pg3k7mvst6GtMR5cAEv++XPpoBWMRpc6kXyw3lb+Uukjxykolyr/SPF2WcEU8zRsEYayUYxi/WyQ==',key_name='tempest-keypair-56259378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-ffq07oni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:02:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=ca9a34ab-50c7-4278-b247-c7a7baeb5968,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:02:54.122815 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:02:54.123262 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ff:6f,bridge_name='br-int',has_traffic_filtering=True,id=7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eafe7fe-12') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:02:54.123702 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'pci_devices' on Instance uuid ca9a34ab-50c7-4278-b247-c7a7baeb5968 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:02:54.530809 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-d25b487d-8f35-475e-a34e-0d04aefa763d req-f47ca9ea-430b-4cdf-af66-3139f7bbba96 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] End _get_guest_xml xml= Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: ca9a34ab-50c7-4278-b247-c7a7baeb5968 Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: instance-0000003f Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-server-612125545 Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:02:54 Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-1262198412-project-member Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-1262198412 Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: ca9a34ab-50c7-4278-b247-c7a7baeb5968 Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: ca9a34ab-50c7-4278-b247-c7a7baeb5968 Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: Jan 26 19:02:54.626755 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:02:54.628661 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Preparing to wait for external event network-vif-plugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:02:54.628661 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:02:54.628661 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:02:54.628661 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:02:54.631804 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-612125545',display_name='tempest-ServerActionsTestOtherB-server-612125545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-612125545',id=63,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK72/fZgFXc8Nm23qFp5bqxu5uQWjdqvi6tf0S8eHH5LAOejrjAG2pg3k7mvst6GtMR5cAEv++XPpoBWMRpc6kXyw3lb+Uukjxykolyr/SPF2WcEU8zRsEYayUYxi/WyQ==',key_name='tempest-keypair-56259378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-ffq07oni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:02:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=ca9a34ab-50c7-4278-b247-c7a7baeb5968,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:02:54.631804 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:02:54.631804 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ff:6f,bridge_name='br-int',has_traffic_filtering=True,id=7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eafe7fe-12') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:02:54.632385 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ff:6f,bridge_name='br-int',has_traffic_filtering=True,id=7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eafe7fe-12') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:02:54.632385 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:02:54.632385 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:02:54.632385 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:02:54.633480 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:02:54.633519 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fddbf34b-094e-5557-b6df-1177a6ec5498', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:02:54.635586 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:02:54.639150 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:02:54.641617 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:02:54.641822 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7eafe7fe-12, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:02:54.642143 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7eafe7fe-12, col_values=(('qos', UUID('0e4950d3-ae08-4293-9055-0a5131f4a8bd')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:02:54.642313 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7eafe7fe-12, col_values=(('external_ids', {'iface-id': '7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:ff:6f', 'vm-uuid': 'ca9a34ab-50c7-4278-b247-c7a7baeb5968'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:02:54.644116 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:02:54.646650 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:02:54.651114 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:02:54.652246 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ff:6f,bridge_name='br-int',has_traffic_filtering=True,id=7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eafe7fe-12') Jan 26 19:02:54.773718 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:02:54.825951 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-d25b487d-8f35-475e-a34e-0d04aefa763d req-f47ca9ea-430b-4cdf-af66-3139f7bbba96 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:02:54.845078 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Acquiring lock "refresh_cache-c61cafe4-53dc-4f97-95ce-7920f42bc548" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:02:54.845209 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Acquired lock "refresh_cache-c61cafe4-53dc-4f97-95ce-7920f42bc548" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:02:54.845350 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:02:54.932810 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-d25b487d-8f35-475e-a34e-0d04aefa763d req-f47ca9ea-430b-4cdf-af66-3139f7bbba96 service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Updated VIF entry in instance network info cache for port 945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:02:54.933225 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-d25b487d-8f35-475e-a34e-0d04aefa763d req-f47ca9ea-430b-4cdf-af66-3139f7bbba96 service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Updating instance_info_cache with network_info: [{"id": "945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97", "address": "fa:16:3e:c0:98:80", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap945f0f2b-c3", "ovs_interfaceid": "945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:02:55.348099 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:02:55.436822 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d25b487d-8f35-475e-a34e-0d04aefa763d req-f47ca9ea-430b-4cdf-af66-3139f7bbba96 service nova] Releasing lock "refresh_cache-7c928a35-c5a7-45e1-9e9b-9ea987610ad5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:02:55.655466 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:02:55.833609 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Updating instance_info_cache with network_info: [{"id": "36f759b4-c422-4e36-890d-adda38033305", "address": "fa:16:3e:cb:7d:66", "network": {"id": "b2d9e1cb-f287-433e-b8e1-33c8468fe907", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781104217-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53f4982d229a4b93921b2b76b5371afa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f759b4-c4", "ovs_interfaceid": "36f759b4-c422-4e36-890d-adda38033305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:02:56.185591 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:02:56.185738 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:02:56.185882 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No VIF found with MAC fa:16:3e:5b:ff:6f, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:02:56.186758 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Using config drive Jan 26 19:02:56.336570 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Releasing lock "refresh_cache-c61cafe4-53dc-4f97-95ce-7920f42bc548" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:02:56.693963 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:02:56.785190 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Creating config drive at /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk.config Jan 26 19:02:56.789928 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpzda24l7d {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:02:56.864004 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': True, 'host': 'np0005596550.novalocal', 'execute': None}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:02:56.865379 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:02:56.871030 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.005s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:02:56.871314 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba33efd-ee6f-46c2-ac26-74c8e2711443]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:02:56.873096 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[bd8c3898-ff3f-4394-9a42-5dbdf23e9a2b]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:02:56.873096 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:02:56.873096 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:02:56.873096 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:02:56.873096 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:02:56.873096 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:02:56.873096 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:02:56.873096 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:02:56.873096 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:02:56.873096 np0005596550.novalocal nova-compute[189076]: with open_scini_device() as fd: Jan 26 19:02:56.873096 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:02:56.873096 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:02:56.873096 np0005596550.novalocal nova-compute[189076]: return next(self.gen) Jan 26 19:02:56.873096 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^ Jan 26 19:02:56.873096 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:02:56.873096 np0005596550.novalocal nova-compute[189076]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:02:56.873096 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:02:56.873096 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:02:56.873498 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8c3898-ff3f-4394-9a42-5dbdf23e9a2b]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:02:56.873810 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.scaleio [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:02:56.876019 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.scaleio [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:02:56.876683 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:02:56.883323 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.006s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:02:56.883481 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafa5d93-d6f1-4188-b6a9-56498d47bd54]: (4, ('/dev/vda2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:02:56.884585 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:02:56.891980 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:02:56.893824 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:02:56.893987 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29cf32d-f022-40c3-9bd6-ced37ff5b7c9]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:02:56.895234 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c50f4a-d5f7-4102-913e-03d8ec4236e0]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:02:56.895524 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Running cmd (subprocess): nvme version {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:02:56.911833 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] 'nvme version' failed. Not Retrying. {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:02:56.912235 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] nvme not present on system {{(pid=189076) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:02:56.913531 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=189076) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:02:56.917851 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.lightos [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fefe:a2b2', 'fe80::58ae:f6ff:fe57:250', 'fe80::fc16:3eff:fe28:2ebe', 'fe80::fc16:3eff:fe06:2e61', 'fe80::4c0f:5dff:fe3f:1dd3', 'fe80::fc16:3eff:fec0:9880'] Jan 26 19:02:56.918151 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:02:56.918340 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:02:56.918669 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] <== get_connector_properties: return (53ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': True, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fefe:a2b2', 'fe80::58ae:f6ff:fe57:250', 'fe80::fc16:3eff:fe28:2ebe', 'fe80::fc16:3eff:fe06:2e61', 'fe80::4c0f:5dff:fe3f:1dd3', 'fe80::fc16:3eff:fec0:9880']} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:02:56.921083 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpzda24l7d" returned: 0 in 0.131s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:02:57.003583 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:02:57.018058 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:02:57.202545 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:02:57.202709 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] VM Started (Lifecycle Event) Jan 26 19:02:57.214478 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:02:57.237705 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f7d7e5c1-9232-4f8b-ba8d-ec75232dd9f2 req-e1262b8a-5693-4873-846d-b2adc5d77a34 service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Received event network-vif-plugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:02:57.237917 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f7d7e5c1-9232-4f8b-ba8d-ec75232dd9f2 req-e1262b8a-5693-4873-846d-b2adc5d77a34 service nova] Acquiring lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:02:57.238100 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f7d7e5c1-9232-4f8b-ba8d-ec75232dd9f2 req-e1262b8a-5693-4873-846d-b2adc5d77a34 service nova] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:02:57.238243 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f7d7e5c1-9232-4f8b-ba8d-ec75232dd9f2 req-e1262b8a-5693-4873-846d-b2adc5d77a34 service nova] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:02:57.238403 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f7d7e5c1-9232-4f8b-ba8d-ec75232dd9f2 req-e1262b8a-5693-4873-846d-b2adc5d77a34 service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Processing event network-vif-plugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:02:57.243376 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:02:57.256414 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:02:57.260619 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Instance spawned successfully. Jan 26 19:02:57.261068 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:02:57.354100 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:02:57.361253 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:02:57.365849 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:02:57.366925 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:02:57.724720 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:02:57.729464 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:02:57.774358 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:02:57.774517 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:02:57.775823 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:02:57.775823 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:02:57.775823 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:02:57.775823 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:02:58.233741 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:02:58.233988 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:02:58.234147 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] VM Paused (Lifecycle Event) Jan 26 19:02:58.282234 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Took 6.23 seconds to spawn the instance on the hypervisor. Jan 26 19:02:58.283192 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:02:58.737378 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:02:58.742242 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:02:58.742401 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] VM Resumed (Lifecycle Event) Jan 26 19:02:58.804369 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Took 11.66 seconds to build instance. Jan 26 19:02:59.245474 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:02:59.248160 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:02:59.298398 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7874ee95-685e-4a47-895d-83da12648506 req-48caf853-f47f-43ec-9a03-9efc7997f6ab service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Received event network-vif-plugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:02:59.298806 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7874ee95-685e-4a47-895d-83da12648506 req-48caf853-f47f-43ec-9a03-9efc7997f6ab service nova] Acquiring lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:02:59.299046 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7874ee95-685e-4a47-895d-83da12648506 req-48caf853-f47f-43ec-9a03-9efc7997f6ab service nova] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:02:59.299181 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7874ee95-685e-4a47-895d-83da12648506 req-48caf853-f47f-43ec-9a03-9efc7997f6ab service nova] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:02:59.299322 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7874ee95-685e-4a47-895d-83da12648506 req-48caf853-f47f-43ec-9a03-9efc7997f6ab service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] No waiting events found dispatching network-vif-plugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:02:59.299460 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-7874ee95-685e-4a47-895d-83da12648506 req-48caf853-f47f-43ec-9a03-9efc7997f6ab service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Received unexpected event network-vif-plugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c for instance with vm_state active and task_state None. Jan 26 19:02:59.306994 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b004c5e3-5f2c-42c1-a53d-a7b81607533c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 13.169s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:02:59.643884 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:00.533801 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-658d9b4d-c223-400a-8c7b-6564d3df0f8a req-b4671508-6d98-4b45-aae6-a17401b00c13 service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Received event network-changed-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:03:00.533801 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-658d9b4d-c223-400a-8c7b-6564d3df0f8a req-b4671508-6d98-4b45-aae6-a17401b00c13 service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Refreshing instance network info cache due to event network-changed-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:03:00.533801 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-658d9b4d-c223-400a-8c7b-6564d3df0f8a req-b4671508-6d98-4b45-aae6-a17401b00c13 service nova] Acquiring lock "refresh_cache-ca9a34ab-50c7-4278-b247-c7a7baeb5968" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:03:00.533801 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-658d9b4d-c223-400a-8c7b-6564d3df0f8a req-b4671508-6d98-4b45-aae6-a17401b00c13 service nova] Acquired lock "refresh_cache-ca9a34ab-50c7-4278-b247-c7a7baeb5968" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:03:00.533801 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-658d9b4d-c223-400a-8c7b-6564d3df0f8a req-b4671508-6d98-4b45-aae6-a17401b00c13 service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Refreshing network info cache for port 7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:03:01.036557 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-658d9b4d-c223-400a-8c7b-6564d3df0f8a req-b4671508-6d98-4b45-aae6-a17401b00c13 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:03:01.249051 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-658d9b4d-c223-400a-8c7b-6564d3df0f8a req-b4671508-6d98-4b45-aae6-a17401b00c13 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:03:01.359055 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-658d9b4d-c223-400a-8c7b-6564d3df0f8a req-b4671508-6d98-4b45-aae6-a17401b00c13 service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Updated VIF entry in instance network info cache for port 7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:03:01.359315 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-658d9b4d-c223-400a-8c7b-6564d3df0f8a req-b4671508-6d98-4b45-aae6-a17401b00c13 service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Updating instance_info_cache with network_info: [{"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:03:01.621626 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Starting finish_migration {{(pid=189076) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12668}} Jan 26 19:03:01.622727 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Instance directory exists: not creating {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5157}} Jan 26 19:03:01.623011 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Creating image(s) Jan 26 19:03:01.623361 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Did not create local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5295}} Jan 26 19:03:01.623545 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Ensure instance console log exists: /opt/stack/data/nova/instances/c61cafe4-53dc-4f97-95ce-7920f42bc548/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:03:01.623970 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:01.624190 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:01.624735 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:01.626572 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Start _get_guest_xml network_info=[{"id": "36f759b4-c422-4e36-890d-adda38033305", "address": "fa:16:3e:cb:7d:66", "network": {"id": "b2d9e1cb-f287-433e-b8e1-33c8468fe907", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781104217-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-781104217-network", "vif_mac": "fa:16:3e:cb:7d:66"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53f4982d229a4b93921b2b76b5371afa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f759b4-c4", "ovs_interfaceid": "36f759b4-c422-4e36-890d-adda38033305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '168b35a0-3398-4d64-840a-508b9a962334', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971', 'target_lun': 0, 'volume_id': '3efb2e02-7cf8-4a53-8773-43cb3f187971', 'auth_method': 'CHAP', 'auth_username': 'FKfDNeAt56LA3MMZ5ghZ', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'c61cafe4-53dc-4f97-95ce-7920f42bc548', 'attached_at': '2026-01-27T00:03:00.000000', 'detached_at': '', 'volume_id': '3efb2e02-7cf8-4a53-8773-43cb3f187971', 'serial': '3efb2e02-7cf8-4a53-8773-43cb3f187971'}, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:03:01.630677 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:03:01.631961 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-461829063', uuid='c61cafe4-53dc-4f97-95ce-7920f42bc548'), owner=OwnerMeta(userid='bda1caa6deb04a3faafe2ddccc5e5fef', username='tempest-ServerActionsTestOtherA-497818938-project-member', projectid='53f4982d229a4b93921b2b76b5371afa', projectname='tempest-ServerActionsTestOtherA-497818938'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "36f759b4-c422-4e36-890d-adda38033305", "address": "fa:16:3e:cb:7d:66", "network": {"id": "b2d9e1cb-f287-433e-b8e1-33c8468fe907", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781104217-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-781104217-network", "vif_mac": "fa:16:3e:cb:7d:66"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53f4982d229a4b93921b2b76b5371afa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f759b4-c4", "ovs_interfaceid": "36f759b4-c422-4e36-890d-adda38033305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472181.6315699) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:03:01.633177 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:03:01.633609 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:03:01.634626 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:03:01.635058 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:03:01.636006 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:03:01.636372 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:03:01.636576 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:03:01.636744 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:03:01.636988 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:03:01.637153 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:03:01.637316 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:03:01.637535 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:03:01.637699 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:03:01.637901 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:03:01.638216 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:03:01.638398 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:03:01.641115 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c61cafe4-53dc-4f97-95ce-7920f42bc548/disk.config --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:01.754040 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c61cafe4-53dc-4f97-95ce-7920f42bc548/disk.config --force-share --output=json" returned: 0 in 0.112s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:01.754514 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Acquiring lock "/opt/stack/data/nova/instances/c61cafe4-53dc-4f97-95ce-7920f42bc548/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:01.754904 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "/opt/stack/data/nova/instances/c61cafe4-53dc-4f97-95ce-7920f42bc548/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:01.755970 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "/opt/stack/data/nova/instances/c61cafe4-53dc-4f97-95ce-7920f42bc548/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:01.756398 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Calling os-brick to attach iSCSI Volume {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jan 26 19:03:01.757536 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971', 'target_lun': 0, 'volume_id': '3efb2e02-7cf8-4a53-8773-43cb3f187971', 'auth_method': 'CHAP', 'auth_username': 'FKfDNeAt56LA3MMZ5ghZ', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:03:01.757625 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:03:01.758194 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:03:01.758481 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971', 'target_lun': 0, 'volume_id': '3efb2e02-7cf8-4a53-8773-43cb3f187971', 'auth_method': 'CHAP', 'auth_username': 'FKfDNeAt56LA3MMZ5ghZ', 'auth_password': 'tNjaBif4EJPW9Tuk', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True} {{(pid=189076) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:03:01.759525 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:01.766381 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:03:01.767302 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[45670c08-1430-4de9-b03e-849281d23a02]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:03:01.767302 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:03:01.767302 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:03:01.767302 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:03:01.767302 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:03:01.767302 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:03:01.767302 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:03:01.767302 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:03:01.767302 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:03:01.767302 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:03:01.767302 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:03:01.767302 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:03:01.767302 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:03:01.767302 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:03:01.767302 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:03:01.767302 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:03:01.767302 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:03:01.767302 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:03:01.767302 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:03:01.767302 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:03:01.767302 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:03:01.767302 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:03:01.768105 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[45670c08-1430-4de9-b03e-849281d23a02]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:03:01.768894 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:03:01.769329 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:03:01.769601 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:03:01.770266 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:01.779317 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260" returned: 21 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:01.779440 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[749a6177-b768-4454-b4e7-b251a8db0fae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:03:01.779795 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:03:01.779795 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:03:01.780597 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --interface default --op new {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:01.788906 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:01.789061 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45c45b2-577b-47cb-9365-f5d0a065ed57]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:03:01.789360 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971] added Jan 26 19:03:01.789360 np0005596550.novalocal nova-compute[189076]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:03:01.789360 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:03:01.789360 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:03:01.789360 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:03:01.789505 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=189076) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:03:01.789743 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.020(s), this was the 1st time calling it. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:03:01.789979 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:03:01.863261 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-658d9b4d-c223-400a-8c7b-6564d3df0f8a req-b4671508-6d98-4b45-aae6-a17401b00c13 service nova] Releasing lock "refresh_cache-ca9a34ab-50c7-4278-b247-c7a7baeb5968" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:03:01.893716 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:02.791722 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:03:02.792582 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:02.799975 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:02.800133 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f75883-2888-4b05-90b4-2470e2d61bec]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.name = iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.tpgt = -1 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.startup = automatic Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.leading_login = No Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.iscsi_ifacename = default Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.net_ifacename = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.ipaddress = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.prefix_len = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.hwaddress = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.transport_name = tcp Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.initiatorname = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.state = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.vlan_id = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.vlan_priority = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.vlan_state = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.iface_num = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.mtu = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.port = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.bootproto = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.subnet_mask = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.gateway = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id_state = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.dhcp_dns = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.dhcp_learn_iqn = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.dhcp_req_vendor_id_state = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id_state = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.dhcp_slp_da = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.fragmentation = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.gratuitous_arp = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.incoming_forwarding = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.tos_state = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.tos = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.ttl = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.delayed_ack = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.tcp_nagle = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf_state = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.tcp_timer_scale = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.tcp_timestamp = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.redirect = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.def_task_mgmt_timeout = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.header_digest = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.data_digest = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.immediate_data = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.initial_r2t = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.data_seq_inorder = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.data_pdu_inorder = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.erl = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.max_receive_data_len = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.first_burst_len = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.max_outstanding_r2t = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.max_burst_len = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.chap_auth = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.bidi_chap = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.strict_login_compliance = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.discovery_auth = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: iface.discovery_logout = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.discovery_address = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.discovery_port = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.discovery_type = fw Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.initial_cmdsn = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.initial_login_retry_max = 8 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.xmit_thread_priority = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.cmds_max = 128 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.queue_depth = 32 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.nr_sessions = 1 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.auth.authmethod = None Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.auth.username = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.auth.password = *** Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.auth.username_in = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.auth.password_in = Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.timeo.replacement_timeout = 120 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FastAbort = Yes Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.InitialR2T = No Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ImmediateData = Yes Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxConnections = 1 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ERL = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.scan = auto Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.reopen_max = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.session.conn_reopen_log_freq = 1 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.conn[0].address = 38.102.83.18 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.conn[0].port = 3260 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.conn[0].startup = manual Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.window_size = 524288 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.DataDigest = None Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.IFMarker = No Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.OFMarker = No Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: # END RECORD Jan 26 19:03:02.801094 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:03:02.802464 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:02.814551 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:02.816253 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ae8734-6e67-4ac9-a958-30d7cc15a6db]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:03:02.816650 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:03:02.817312 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:02.825853 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:02.826005 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19c198c-57ff-4a2a-b15f-0d01573c5f7d]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:03:02.826319 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:03:02.826914 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v FKfDNeAt56LA3MMZ5ghZ {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:02.838510 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v FKfDNeAt56LA3MMZ5ghZ" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:02.839349 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a748d270-e0cd-45f7-a661-acd09c79a734]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:03:02.839928 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FKfDNeAt56LA3MMZ5ghZ'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:03:02.841077 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:02.851199 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:02.851389 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f485cf-f1db-489b-8cab-1e53ace6ad9a]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:03:02.851928 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:03:02.853429 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:02.862429 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:02.862679 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2f9fa8-8c75-416e-af5e-0bbc45611bb9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:03:02.863193 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jan 26 19:03:02.863193 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:03:02.863633 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jan 26 19:03:02.863633 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:03:02.863956 np0005596550.novalocal nova-compute[189076]: WARNING os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jan 26 19:03:02.863956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:02.864993 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --login {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:02.882085 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --login" returned: 0 in 0.017s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:02.882264 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4af40d-dd3a-4e31-a485-d31e6cd5ad09]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:03:02.882674 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971, portal: 38.102.83.18,3260] successful. Jan 26 19:03:02.882674 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:03:02.886209 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:02.896315 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:02.896505 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d9afd5-d630-4c9a-b311-572890d53089]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:03:02.897177 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:03:02.897653 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:02.905095 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:02.905251 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4d68e7-0485-49c4-89e9-ab88ffedf95d]: (4, ('tcp: [6] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:03:02.905553 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 (non-flash) Jan 26 19:03:02.905553 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:03:02.905691 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsi session list stdout=tcp: [6] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 (non-flash) Jan 26 19:03:02.905691 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:03:02.906016 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:03:02.906227 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Connected to 38.102.83.18:3260 {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:03:02.906551 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] HCTL ('2', '-', '-', 0) found on session 6 with lun 0 {{(pid=189076) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:03:02.906667 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Scanning host 2 c: -, t: -, l: 0) {{(pid=189076) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:03:02.908870 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host2/scan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:02.929045 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host2/scan" returned: 0 in 0.021s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:02.929214 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94115a4-349d-43e8-8982-fa93d51cdd42]: (4, ('- - 0', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:03:02.929914 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Searching for a device in session 6 and hctl ['2', '*', '*', 0] yield: sda {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:03:02.930389 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Connected to sda using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971', 'target_lun': 0, 'volume_id': '3efb2e02-7cf8-4a53-8773-43cb3f187971', 'auth_method': 'CHAP', 'auth_username': 'FKfDNeAt56LA3MMZ5ghZ', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True} {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:03:03.932610 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.174s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:03:03.932881 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] <== connect_volume: return (2175ms) {'type': 'block', 'scsi_wwn': '36001405f7d4dd0e147c448092a8afa49', 'path': '/dev/sda'} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:03:03.933074 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '36001405f7d4dd0e147c448092a8afa49', 'path': '/dev/sda'} {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jan 26 19:03:04.447062 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:02:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-461829063',display_name='tempest-ServerActionsTestOtherA-server-461829063',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestothera-server-461829063',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkm/PVAmYQe14oR+m9oifK9GF7IRXRKATSBpMRQ3qYZZ/vFrXZ5EXOuwi6xUe/eQG+fKh0mbpJCQePf/1R2TGvrtb52X0k1pDlW6qTQXyKWpF8WgH7Q3fLblq1m21/gFw==',key_name='tempest-keypair-542846393',keypairs=,launch_index=0,launched_at=2026-01-27T00:02:38Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='53f4982d229a4b93921b2b76b5371afa',ramdisk_id='',reservation_id='r-jvssr09t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-497818938',owner_user_name='tempest-ServerActionsTestOtherA-497818938-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:02:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bda1caa6deb04a3faafe2ddccc5e5fef',uuid=c61cafe4-53dc-4f97-95ce-7920f42bc548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36f759b4-c422-4e36-890d-adda38033305", "address": "fa:16:3e:cb:7d:66", "network": {"id": "b2d9e1cb-f287-433e-b8e1-33c8468fe907", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781104217-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-781104217-network", "vif_mac": "fa:16:3e:cb:7d:66"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53f4982d229a4b93921b2b76b5371afa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f759b4-c4", "ovs_interfaceid": "36f759b4-c422-4e36-890d-adda38033305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:03:04.447474 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Converting VIF {"id": "36f759b4-c422-4e36-890d-adda38033305", "address": "fa:16:3e:cb:7d:66", "network": {"id": "b2d9e1cb-f287-433e-b8e1-33c8468fe907", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781104217-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-781104217-network", "vif_mac": "fa:16:3e:cb:7d:66"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53f4982d229a4b93921b2b76b5371afa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f759b4-c4", "ovs_interfaceid": "36f759b4-c422-4e36-890d-adda38033305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:03:04.448340 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:7d:66,bridge_name='br-int',has_traffic_filtering=True,id=36f759b4-c422-4e36-890d-adda38033305,network=Network(b2d9e1cb-f287-433e-b8e1-33c8468fe907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f759b4-c4') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] End _get_guest_xml xml= Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: c61cafe4-53dc-4f97-95ce-7920f42bc548 Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: instance-0000003d Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: 262144 Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherA-server-461829063 Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:03:01 Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: 256 Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: ide Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: pc Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherA-497818938-project-member Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherA-497818938 Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: c61cafe4-53dc-4f97-95ce-7920f42bc548 Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: c61cafe4-53dc-4f97-95ce-7920f42bc548 Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: 3efb2e02-7cf8-4a53-8773-43cb3f187971 Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:04.452685 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:03:04.454381 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:02:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-461829063',display_name='tempest-ServerActionsTestOtherA-server-461829063',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestothera-server-461829063',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkm/PVAmYQe14oR+m9oifK9GF7IRXRKATSBpMRQ3qYZZ/vFrXZ5EXOuwi6xUe/eQG+fKh0mbpJCQePf/1R2TGvrtb52X0k1pDlW6qTQXyKWpF8WgH7Q3fLblq1m21/gFw==',key_name='tempest-keypair-542846393',keypairs=,launch_index=0,launched_at=2026-01-27T00:02:38Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='53f4982d229a4b93921b2b76b5371afa',ramdisk_id='',reservation_id='r-jvssr09t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-497818938',owner_user_name='tempest-ServerActionsTestOtherA-497818938-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:02:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bda1caa6deb04a3faafe2ddccc5e5fef',uuid=c61cafe4-53dc-4f97-95ce-7920f42bc548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36f759b4-c422-4e36-890d-adda38033305", "address": "fa:16:3e:cb:7d:66", "network": {"id": "b2d9e1cb-f287-433e-b8e1-33c8468fe907", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781104217-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-781104217-network", "vif_mac": "fa:16:3e:cb:7d:66"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53f4982d229a4b93921b2b76b5371afa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f759b4-c4", "ovs_interfaceid": "36f759b4-c422-4e36-890d-adda38033305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:03:04.454381 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Converting VIF {"id": "36f759b4-c422-4e36-890d-adda38033305", "address": "fa:16:3e:cb:7d:66", "network": {"id": "b2d9e1cb-f287-433e-b8e1-33c8468fe907", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781104217-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-781104217-network", "vif_mac": "fa:16:3e:cb:7d:66"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53f4982d229a4b93921b2b76b5371afa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f759b4-c4", "ovs_interfaceid": "36f759b4-c422-4e36-890d-adda38033305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:03:04.456207 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:7d:66,bridge_name='br-int',has_traffic_filtering=True,id=36f759b4-c422-4e36-890d-adda38033305,network=Network(b2d9e1cb-f287-433e-b8e1-33c8468fe907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f759b4-c4') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:03:04.456553 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:7d:66,bridge_name='br-int',has_traffic_filtering=True,id=36f759b4-c422-4e36-890d-adda38033305,network=Network(b2d9e1cb-f287-433e-b8e1-33c8468fe907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f759b4-c4') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:03:04.457060 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:04.457385 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:03:04.457686 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:03:04.458607 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:04.460126 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e80bc9d6-db66-5ee3-9e77-af3c9ff8c774', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:03:04.463016 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:04.464685 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:04.468081 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:04.468341 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36f759b4-c4, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:03:04.468741 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36f759b4-c4, col_values=(('qos', UUID('6179de44-815e-49dc-9b85-320fcd8f79ab')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:03:04.469032 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36f759b4-c4, col_values=(('external_ids', {'iface-id': '36f759b4-c422-4e36-890d-adda38033305', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:7d:66', 'vm-uuid': 'c61cafe4-53dc-4f97-95ce-7920f42bc548'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:03:04.470130 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:04.476318 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:03:04.477534 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:04.479315 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:7d:66,bridge_name='br-int',has_traffic_filtering=True,id=36f759b4-c422-4e36-890d-adda38033305,network=Network(b2d9e1cb-f287-433e-b8e1-33c8468fe907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f759b4-c4') Jan 26 19:03:05.947281 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:03:05.947281 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] VM Stopped (Lifecycle Event) Jan 26 19:03:06.005701 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:03:06.005918 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:03:06.006116 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] No VIF found with MAC fa:16:3e:cb:7d:66, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:03:06.006679 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Using config drive Jan 26 19:03:06.065387 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:06.076951 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:06.080380 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:06.214639 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:06.217154 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:06.269296 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for c61cafe4-53dc-4f97-95ce-7920f42bc548 due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:03:06.269460 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:03:06.269599 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] VM Resumed (Lifecycle Event) Jan 26 19:03:06.271126 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Instance event wait completed in 0 seconds for {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:03:06.280319 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-09747920-5cc7-4f87-b93f-fb61c0c49237 req-c9ffc543-6a12-4095-88d2-1a427daa391e service nova] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Received event network-vif-plugged-36f759b4-c422-4e36-890d-adda38033305 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:03:06.280523 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-09747920-5cc7-4f87-b93f-fb61c0c49237 req-c9ffc543-6a12-4095-88d2-1a427daa391e service nova] Acquiring lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:06.284170 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-09747920-5cc7-4f87-b93f-fb61c0c49237 req-c9ffc543-6a12-4095-88d2-1a427daa391e service nova] Lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:06.284464 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-09747920-5cc7-4f87-b93f-fb61c0c49237 req-c9ffc543-6a12-4095-88d2-1a427daa391e service nova] Lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.004s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:06.284685 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-09747920-5cc7-4f87-b93f-fb61c0c49237 req-c9ffc543-6a12-4095-88d2-1a427daa391e service nova] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] No waiting events found dispatching network-vif-plugged-36f759b4-c422-4e36-890d-adda38033305 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:03:06.284952 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-09747920-5cc7-4f87-b93f-fb61c0c49237 req-c9ffc543-6a12-4095-88d2-1a427daa391e service nova] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Received unexpected event network-vif-plugged-36f759b4-c422-4e36-890d-adda38033305 for instance with vm_state active and task_state resize_finish. Jan 26 19:03:06.287194 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Instance running successfully. Jan 26 19:03:06.287941 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Failed to set time: agent not configured {{(pid=189076) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}} Jan 26 19:03:06.288143 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-21092a36-85cd-42ed-8fa9-6d7c1e358643 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] finish_migration finished successfully. {{(pid=189076) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12763}} Jan 26 19:03:06.460014 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-babe4439-4392-4205-aea5-f45bc0e17dbf None None] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:03:06.772753 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:03:06.775917 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:03:06.902693 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:07.278875 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] During sync_power_state the instance has a pending task (resize_finish). Skip. Jan 26 19:03:07.279292 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:03:07.279292 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] VM Started (Lifecycle Event) Jan 26 19:03:07.782728 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:03:07.785589 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:03:08.324799 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-dc8c1d8f-79b5-4a72-bc1f-99825f6b654f req-a96ddf59-62cd-42a8-80f3-588ba4bc334e service nova] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Received event network-vif-plugged-36f759b4-c422-4e36-890d-adda38033305 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:03:08.325174 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-dc8c1d8f-79b5-4a72-bc1f-99825f6b654f req-a96ddf59-62cd-42a8-80f3-588ba4bc334e service nova] Acquiring lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:08.325174 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-dc8c1d8f-79b5-4a72-bc1f-99825f6b654f req-a96ddf59-62cd-42a8-80f3-588ba4bc334e service nova] Lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:08.325320 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-dc8c1d8f-79b5-4a72-bc1f-99825f6b654f req-a96ddf59-62cd-42a8-80f3-588ba4bc334e service nova] Lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:08.325479 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-dc8c1d8f-79b5-4a72-bc1f-99825f6b654f req-a96ddf59-62cd-42a8-80f3-588ba4bc334e service nova] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] No waiting events found dispatching network-vif-plugged-36f759b4-c422-4e36-890d-adda38033305 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:03:08.325645 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-dc8c1d8f-79b5-4a72-bc1f-99825f6b654f req-a96ddf59-62cd-42a8-80f3-588ba4bc334e service nova] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Received unexpected event network-vif-plugged-36f759b4-c422-4e36-890d-adda38033305 for instance with vm_state resized and task_state None. Jan 26 19:03:08.539026 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ad966b96-396b-4ab5-ae16-80ca2387c1a3 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Acquiring lock "c61cafe4-53dc-4f97-95ce-7920f42bc548" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:08.539205 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ad966b96-396b-4ab5-ae16-80ca2387c1a3 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "c61cafe4-53dc-4f97-95ce-7920f42bc548" acquired by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:08.539357 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ad966b96-396b-4ab5-ae16-80ca2387c1a3 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Going to confirm migration 4 {{(pid=189076) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5331}} Jan 26 19:03:08.896840 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:03:08.897072 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:03:09.049936 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-ad966b96-396b-4ab5-ae16-80ca2387c1a3 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:03:09.109400 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-ad966b96-396b-4ab5-ae16-80ca2387c1a3 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:03:09.109848 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ad966b96-396b-4ab5-ae16-80ca2387c1a3 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Acquiring lock "refresh_cache-c61cafe4-53dc-4f97-95ce-7920f42bc548" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:03:09.110046 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ad966b96-396b-4ab5-ae16-80ca2387c1a3 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Acquired lock "refresh_cache-c61cafe4-53dc-4f97-95ce-7920f42bc548" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:03:09.110312 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-ad966b96-396b-4ab5-ae16-80ca2387c1a3 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:03:09.110553 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-ad966b96-396b-4ab5-ae16-80ca2387c1a3 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lazy-loading 'info_cache' on Instance uuid c61cafe4-53dc-4f97-95ce-7920f42bc548 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:03:09.469789 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:10.119873 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-ad966b96-396b-4ab5-ae16-80ca2387c1a3 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:03:10.409443 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-ad966b96-396b-4ab5-ae16-80ca2387c1a3 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:03:10.561393 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-ad966b96-396b-4ab5-ae16-80ca2387c1a3 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Updating instance_info_cache with network_info: [{"id": "36f759b4-c422-4e36-890d-adda38033305", "address": "fa:16:3e:cb:7d:66", "network": {"id": "b2d9e1cb-f287-433e-b8e1-33c8468fe907", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781104217-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53f4982d229a4b93921b2b76b5371afa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f759b4-c4", "ovs_interfaceid": "36f759b4-c422-4e36-890d-adda38033305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:03:10.892477 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:03:10.895063 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:03:11.064780 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ad966b96-396b-4ab5-ae16-80ca2387c1a3 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Releasing lock "refresh_cache-c61cafe4-53dc-4f97-95ce-7920f42bc548" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:03:11.065178 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-ad966b96-396b-4ab5-ae16-80ca2387c1a3 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lazy-loading 'migration_context' on Instance uuid c61cafe4-53dc-4f97-95ce-7920f42bc548 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:03:11.399647 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:11.399905 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:11.400060 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:11.400209 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:03:11.568759 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-ad966b96-396b-4ab5-ae16-80ca2387c1a3 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Object Instance lazy-loaded attributes: info_cache,migration_context {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:03:11.569799 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ad966b96-396b-4ab5-ae16-80ca2387c1a3 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:11.570041 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ad966b96-396b-4ab5-ae16-80ca2387c1a3 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:11.896398 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:12.378426 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ad966b96-396b-4ab5-ae16-80ca2387c1a3 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:03:12.450978 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/641862e8-df87-43f7-8022-ccdc6701e4ae/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:12.526466 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/641862e8-df87-43f7-8022-ccdc6701e4ae/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:12.526870 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/641862e8-df87-43f7-8022-ccdc6701e4ae/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:12.620476 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/641862e8-df87-43f7-8022-ccdc6701e4ae/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:12.628952 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:12.699847 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12/disk --force-share --output=json" returned: 0 in 0.070s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:12.701466 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:12.777351 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:12.781289 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] skipping disk /dev/sda (vda) as it is a volume {{(pid=189076) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12209}} Jan 26 19:03:12.783880 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:12.874802 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:12.875361 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:12.885689 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ad966b96-396b-4ab5-ae16-80ca2387c1a3 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:03:12.956138 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:12.961269 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:13.062795 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:13.062795 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:13.145156 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:13.148758 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75069ad-e74f-4328-9089-5400c8fbc9bf/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:13.240696 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75069ad-e74f-4328-9089-5400c8fbc9bf/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:13.241300 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75069ad-e74f-4328-9089-5400c8fbc9bf/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:13.333130 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75069ad-e74f-4328-9089-5400c8fbc9bf/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:13.499788 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:03:13.500634 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:13.523318 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.022s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:13.523622 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=6661MB free_disk=373.4440269470215GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:03:13.523816 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:13.904447 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ad966b96-396b-4ab5-ae16-80ca2387c1a3 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.334s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:13.908326 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.384s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:14.457642 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-af60b7a9-90df-444d-b35e-64bd979e8abd tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Get console output Jan 26 19:03:14.463541 np0005596550.novalocal nova-compute[189076]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes Jan 26 19:03:14.480460 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:14.517751 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-ad966b96-396b-4ab5-ae16-80ca2387c1a3 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Deleted allocation for migration 1790c7e3-df3b-4459-9ba0-6eb9efd0d721 Jan 26 19:03:14.995350 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance d9448760-8b72-4805-9dd0-368ccddaaa12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:03:14.995610 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance b75069ad-e74f-4328-9089-5400c8fbc9bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:03:14.995664 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 641862e8-df87-43f7-8022-ccdc6701e4ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:03:14.995902 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 7c928a35-c5a7-45e1-9e9b-9ea987610ad5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:03:14.996093 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance c61cafe4-53dc-4f97-95ce-7920f42bc548 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:03:14.996195 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance ca9a34ab-50c7-4278-b247-c7a7baeb5968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:03:14.996378 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 6 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:03:14.996577 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=1728MB phys_disk=399GB used_disk=5GB total_vcpus=8 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:03:13 up 31 min, 12 users, load average: 5.07, 4.80, 3.36\n', 'num_instances': '6', 'num_vm_active': '5', 'num_task_None': '6', 'num_os_type_None': '6', 'num_proj_2efcb8570b994820a5956fab4e859054': '2', 'io_workload': '0', 'num_proj_53f4982d229a4b93921b2b76b5371afa': '3', 'num_vm_resized': '1', 'num_proj_8428b9d1e48c42f690612bf1e012ec42': '1'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:03:15.021580 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ad966b96-396b-4ab5-ae16-80ca2387c1a3 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "c61cafe4-53dc-4f97-95ce-7920f42bc548" "released" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: held 6.482s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:15.223843 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:03:15.727989 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:03:16.233493 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:03:16.233897 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.325s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:16.899305 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:17.235071 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:03:17.235451 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:03:17.235451 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:03:17.235644 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:03:17.235850 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:03:17.236017 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:03:19.482604 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:21.902801 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:24.484718 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:26.903230 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:29.531245 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:30.306075 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Rebuilding instance Jan 26 19:03:30.433750 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:03:31.473850 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:31.481594 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:31.486187 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:31.607916 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:31.613607 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d66c05e0-16d0-4e27-904d-936b0099e6ff req-86571b0f-6f66-4eda-8eda-51ace1fd2966 service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Received event network-vif-unplugged-945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:03:31.613607 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d66c05e0-16d0-4e27-904d-936b0099e6ff req-86571b0f-6f66-4eda-8eda-51ace1fd2966 service nova] Acquiring lock "7c928a35-c5a7-45e1-9e9b-9ea987610ad5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:31.613681 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d66c05e0-16d0-4e27-904d-936b0099e6ff req-86571b0f-6f66-4eda-8eda-51ace1fd2966 service nova] Lock "7c928a35-c5a7-45e1-9e9b-9ea987610ad5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:31.613831 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d66c05e0-16d0-4e27-904d-936b0099e6ff req-86571b0f-6f66-4eda-8eda-51ace1fd2966 service nova] Lock "7c928a35-c5a7-45e1-9e9b-9ea987610ad5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:31.614021 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d66c05e0-16d0-4e27-904d-936b0099e6ff req-86571b0f-6f66-4eda-8eda-51ace1fd2966 service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] No waiting events found dispatching network-vif-unplugged-945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:03:31.614211 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-d66c05e0-16d0-4e27-904d-936b0099e6ff req-86571b0f-6f66-4eda-8eda-51ace1fd2966 service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Received unexpected event network-vif-unplugged-945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97 for instance with vm_state active and task_state rebuilding. Jan 26 19:03:31.614513 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:31.717430 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Instance destroyed successfully. Jan 26 19:03:31.724099 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Instance destroyed successfully. Jan 26 19:03:31.725892 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1105651410',display_name='tempest-ServerActionsTestJSON-server-909849696',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-tempest-common-compute-instance-1105651410',id=62,image_ref='bd70f82e-84e0-4042-ad07-7b834bb8ac38',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODQV+rXrfw6z4KA1yufoNzcuxA8euoqAV8xhNM1eTx32FraaBLNNd+7KSOhxWGb4Se5AscyVYG5OwF824QWYb2Qix2OjY87hMenK3O9pQ0SdEoKcqePuRK0jjvpL4YrRQ==',key_name='tempest-keypair-491827368',keypairs=,launch_index=0,launched_at=2026-01-27T00:02:50Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-ishtpvhj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bd70f82e-84e0-4042-ad07-7b834bb8ac38',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:03:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=7c928a35-c5a7-45e1-9e9b-9ea987610ad5,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97", "address": "fa:16:3e:c0:98:80", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap945f0f2b-c3", "ovs_interfaceid": "945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:03:31.726054 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97", "address": "fa:16:3e:c0:98:80", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap945f0f2b-c3", "ovs_interfaceid": "945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:03:31.726647 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:98:80,bridge_name='br-int',has_traffic_filtering=True,id=945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945f0f2b-c3') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:03:31.727022 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:98:80,bridge_name='br-int',has_traffic_filtering=True,id=945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945f0f2b-c3') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:03:31.728197 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:31.728448 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap945f0f2b-c3, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:03:31.730399 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:31.732116 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:03:31.732652 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:31.732840 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a10d465-9867-4601-a880-73111ca83086) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:03:31.733450 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:31.735070 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:03:31.736946 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:98:80,bridge_name='br-int',has_traffic_filtering=True,id=945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945f0f2b-c3') Jan 26 19:03:31.737260 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Deleting instance files /opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5_del Jan 26 19:03:31.738068 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Deletion of /opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5_del complete Jan 26 19:03:31.905420 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:33.258353 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:03:33.258815 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Creating image(s) Jan 26 19:03:33.259366 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:33.259653 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "/opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:33.260420 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "/opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:33.260989 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:03:33.265506 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:03:33.268111 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:33.353798 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json" returned: 0 in 0.085s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:33.354488 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "791283f4306f6266c365d052f132d740f0c9b85f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:33.355447 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "791283f4306f6266c365d052f132d740f0c9b85f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:33.356375 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:03:33.363151 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:03:33.363867 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:33.430657 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json" returned: 0 in 0.067s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:33.431198 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f,backing_fmt=raw /opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:33.473525 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f,backing_fmt=raw /opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5/disk 1073741824" returned: 0 in 0.042s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:33.473965 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "791283f4306f6266c365d052f132d740f0c9b85f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.119s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:33.474352 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:33.563630 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json" returned: 0 in 0.089s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:33.564082 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:03:33.564639 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:33.641941 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:33.642291 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Cannot resize image /opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:03:33.642598 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:03:33.642791 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Ensure instance console log exists: /opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:03:33.643118 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:33.643420 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:33.645831 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:33.645831 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Start _get_guest_xml network_info=[{"id": "945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97", "address": "fa:16:3e:c0:98:80", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap945f0f2b-c3", "ovs_interfaceid": "945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-01-26T23:49:28Z,direct_url=,disk_format='qcow2',id=bd70f82e-84e0-4042-ad07-7b834bb8ac38,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-01-26T23:49:31Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:03:33.648218 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-0d0b3fae-eb21-470d-a80e-7ed1ce8ea4fb req-6deb33bf-66fa-4de5-a6dc-2f8dedb62dea service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Received event network-vif-unplugged-945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:03:33.648378 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-0d0b3fae-eb21-470d-a80e-7ed1ce8ea4fb req-6deb33bf-66fa-4de5-a6dc-2f8dedb62dea service nova] Acquiring lock "7c928a35-c5a7-45e1-9e9b-9ea987610ad5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:33.648546 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-0d0b3fae-eb21-470d-a80e-7ed1ce8ea4fb req-6deb33bf-66fa-4de5-a6dc-2f8dedb62dea service nova] Lock "7c928a35-c5a7-45e1-9e9b-9ea987610ad5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:33.648703 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-0d0b3fae-eb21-470d-a80e-7ed1ce8ea4fb req-6deb33bf-66fa-4de5-a6dc-2f8dedb62dea service nova] Lock "7c928a35-c5a7-45e1-9e9b-9ea987610ad5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:33.648880 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-0d0b3fae-eb21-470d-a80e-7ed1ce8ea4fb req-6deb33bf-66fa-4de5-a6dc-2f8dedb62dea service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] No waiting events found dispatching network-vif-unplugged-945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:03:33.649123 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-0d0b3fae-eb21-470d-a80e-7ed1ce8ea4fb req-6deb33bf-66fa-4de5-a6dc-2f8dedb62dea service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Received unexpected event network-vif-unplugged-945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97 for instance with vm_state active and task_state rebuild_spawning. Jan 26 19:03:33.651596 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError Jan 26 19:03:33.652539 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bd70f82e-84e0-4042-ad07-7b834bb8ac38', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestJSON-server-909849696', uuid='7c928a35-c5a7-45e1-9e9b-9ea987610ad5'), owner=OwnerMeta(userid='25c3c9ca754941ccbd986028c2a87e07', username='tempest-ServerActionsTestJSON-960489083-project-member', projectid='2efcb8570b994820a5956fab4e859054', projectname='tempest-ServerActionsTestJSON-960489083'), image=ImageMeta(id='bd70f82e-84e0-4042-ad07-7b834bb8ac38', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97", "address": "fa:16:3e:c0:98:80", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap945f0f2b-c3", "ovs_interfaceid": "945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472213.6522439) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:03:33.653904 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:03:33.654282 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:03:33.657529 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:03:33.657895 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:03:33.658839 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:03:33.659155 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-01-26T23:49:28Z,direct_url=,disk_format='qcow2',id=bd70f82e-84e0-4042-ad07-7b834bb8ac38,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-01-26T23:49:31Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:03:33.659319 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:03:33.659450 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:03:33.659607 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:03:33.659730 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:03:33.659885 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:03:33.660051 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:03:33.660177 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:03:33.660315 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:03:33.660447 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:03:33.660584 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:03:33.660744 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7c928a35-c5a7-45e1-9e9b-9ea987610ad5 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:03:34.169573 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-01-27T00:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1105651410',display_name='tempest-ServerActionsTestJSON-server-909849696',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-tempest-common-compute-instance-1105651410',id=62,image_ref='bd70f82e-84e0-4042-ad07-7b834bb8ac38',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODQV+rXrfw6z4KA1yufoNzcuxA8euoqAV8xhNM1eTx32FraaBLNNd+7KSOhxWGb4Se5AscyVYG5OwF824QWYb2Qix2OjY87hMenK3O9pQ0SdEoKcqePuRK0jjvpL4YrRQ==',key_name='tempest-keypair-491827368',keypairs=,launch_index=0,launched_at=2026-01-27T00:02:50Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-ishtpvhj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bd70f82e-84e0-4042-ad07-7b834bb8ac38',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:03:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=7c928a35-c5a7-45e1-9e9b-9ea987610ad5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97", "address": "fa:16:3e:c0:98:80", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap945f0f2b-c3", "ovs_interfaceid": "945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:03:34.169962 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97", "address": "fa:16:3e:c0:98:80", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap945f0f2b-c3", "ovs_interfaceid": "945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:03:34.170730 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:98:80,bridge_name='br-int',has_traffic_filtering=True,id=945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945f0f2b-c3') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] End _get_guest_xml xml= Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5 Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: instance-0000003e Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestJSON-server-909849696 Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:03:33 Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestJSON-960489083-project-member Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestJSON-960489083 Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5 Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5 Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: Jan 26 19:03:34.172454 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:03:34.175869 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-01-27T00:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1105651410',display_name='tempest-ServerActionsTestJSON-server-909849696',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-tempest-common-compute-instance-1105651410',id=62,image_ref='bd70f82e-84e0-4042-ad07-7b834bb8ac38',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODQV+rXrfw6z4KA1yufoNzcuxA8euoqAV8xhNM1eTx32FraaBLNNd+7KSOhxWGb4Se5AscyVYG5OwF824QWYb2Qix2OjY87hMenK3O9pQ0SdEoKcqePuRK0jjvpL4YrRQ==',key_name='tempest-keypair-491827368',keypairs=,launch_index=0,launched_at=2026-01-27T00:02:50Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-ishtpvhj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bd70f82e-84e0-4042-ad07-7b834bb8ac38',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:03:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=7c928a35-c5a7-45e1-9e9b-9ea987610ad5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97", "address": "fa:16:3e:c0:98:80", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap945f0f2b-c3", "ovs_interfaceid": "945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:03:34.175869 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97", "address": "fa:16:3e:c0:98:80", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap945f0f2b-c3", "ovs_interfaceid": "945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:03:34.175869 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:98:80,bridge_name='br-int',has_traffic_filtering=True,id=945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945f0f2b-c3') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:03:34.176271 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:98:80,bridge_name='br-int',has_traffic_filtering=True,id=945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945f0f2b-c3') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:03:34.176271 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:34.176271 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:03:34.176271 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:03:34.177434 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:34.177694 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26d29321-7332-5dac-86f9-f97df0ff2a9e', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:03:34.219128 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:34.221955 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:34.225712 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:34.226012 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap945f0f2b-c3, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:03:34.226430 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap945f0f2b-c3, col_values=(('qos', UUID('c945d82e-4f3c-4565-8a83-4a864d8e5213')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:03:34.226662 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap945f0f2b-c3, col_values=(('external_ids', {'iface-id': '945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:98:80', 'vm-uuid': '7c928a35-c5a7-45e1-9e9b-9ea987610ad5'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:03:34.227804 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:34.230413 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:03:34.236458 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:34.237534 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:98:80,bridge_name='br-int',has_traffic_filtering=True,id=945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945f0f2b-c3') Jan 26 19:03:35.608715 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Acquiring lock "c61cafe4-53dc-4f97-95ce-7920f42bc548" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:35.609146 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "c61cafe4-53dc-4f97-95ce-7920f42bc548" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:35.609184 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Acquiring lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:35.609482 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:35.609636 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:35.612128 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Terminating instance Jan 26 19:03:35.758321 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:03:35.758453 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:03:35.758623 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] No VIF found with MAC fa:16:3e:c0:98:80, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:03:35.759105 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Using config drive Jan 26 19:03:36.117012 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:03:36.170946 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:36.184396 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:36.263471 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'ec2_ids' on Instance uuid 7c928a35-c5a7-45e1-9e9b-9ea987610ad5 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:03:36.312646 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5e3a83bb-9913-494f-bfa3-449e03b724ff req-c9a305e9-1752-4665-a6dc-9569459149a2 service nova] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Received event network-vif-unplugged-36f759b4-c422-4e36-890d-adda38033305 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:03:36.312646 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5e3a83bb-9913-494f-bfa3-449e03b724ff req-c9a305e9-1752-4665-a6dc-9569459149a2 service nova] Acquiring lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:36.312646 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5e3a83bb-9913-494f-bfa3-449e03b724ff req-c9a305e9-1752-4665-a6dc-9569459149a2 service nova] Lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:36.313046 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5e3a83bb-9913-494f-bfa3-449e03b724ff req-c9a305e9-1752-4665-a6dc-9569459149a2 service nova] Lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:36.313046 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5e3a83bb-9913-494f-bfa3-449e03b724ff req-c9a305e9-1752-4665-a6dc-9569459149a2 service nova] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] No waiting events found dispatching network-vif-unplugged-36f759b4-c422-4e36-890d-adda38033305 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:03:36.313254 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5e3a83bb-9913-494f-bfa3-449e03b724ff req-c9a305e9-1752-4665-a6dc-9569459149a2 service nova] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Received event network-vif-unplugged-36f759b4-c422-4e36-890d-adda38033305 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:03:36.322343 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:36.330202 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:36.418115 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Instance destroyed successfully. Jan 26 19:03:36.418115 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lazy-loading 'resources' on Instance uuid c61cafe4-53dc-4f97-95ce-7920f42bc548 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:03:36.773181 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Object Instance<7c928a35-c5a7-45e1-9e9b-9ea987610ad5> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:03:36.773469 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'keypairs' on Instance uuid 7c928a35-c5a7-45e1-9e9b-9ea987610ad5 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:03:36.908549 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:36.922993 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:02:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-461829063',display_name='tempest-ServerActionsTestOtherA-server-461829063',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestothera-server-461829063',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkm/PVAmYQe14oR+m9oifK9GF7IRXRKATSBpMRQ3qYZZ/vFrXZ5EXOuwi6xUe/eQG+fKh0mbpJCQePf/1R2TGvrtb52X0k1pDlW6qTQXyKWpF8WgH7Q3fLblq1m21/gFw==',key_name='tempest-keypair-542846393',keypairs=,launch_index=0,launched_at=2026-01-27T00:03:06Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='53f4982d229a4b93921b2b76b5371afa',ramdisk_id='',reservation_id='r-jvssr09t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-497818938',owner_user_name='tempest-ServerActionsTestOtherA-497818938-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:03:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bda1caa6deb04a3faafe2ddccc5e5fef',uuid=c61cafe4-53dc-4f97-95ce-7920f42bc548,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36f759b4-c422-4e36-890d-adda38033305", "address": "fa:16:3e:cb:7d:66", "network": {"id": "b2d9e1cb-f287-433e-b8e1-33c8468fe907", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781104217-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53f4982d229a4b93921b2b76b5371afa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f759b4-c4", "ovs_interfaceid": "36f759b4-c422-4e36-890d-adda38033305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:03:36.923334 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Converting VIF {"id": "36f759b4-c422-4e36-890d-adda38033305", "address": "fa:16:3e:cb:7d:66", "network": {"id": "b2d9e1cb-f287-433e-b8e1-33c8468fe907", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781104217-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53f4982d229a4b93921b2b76b5371afa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f759b4-c4", "ovs_interfaceid": "36f759b4-c422-4e36-890d-adda38033305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:03:36.923840 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:7d:66,bridge_name='br-int',has_traffic_filtering=True,id=36f759b4-c422-4e36-890d-adda38033305,network=Network(b2d9e1cb-f287-433e-b8e1-33c8468fe907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f759b4-c4') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:03:36.924172 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:7d:66,bridge_name='br-int',has_traffic_filtering=True,id=36f759b4-c422-4e36-890d-adda38033305,network=Network(b2d9e1cb-f287-433e-b8e1-33c8468fe907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f759b4-c4') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:03:36.925560 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:36.929123 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36f759b4-c4, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:03:36.930979 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:36.932928 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:03:36.937614 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:36.938498 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:36.938694 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6179de44-815e-49dc-9b85-320fcd8f79ab) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:03:36.941859 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:36.944347 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:36.947312 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:7d:66,bridge_name='br-int',has_traffic_filtering=True,id=36f759b4-c422-4e36-890d-adda38033305,network=Network(b2d9e1cb-f287-433e-b8e1-33c8468fe907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f759b4-c4') Jan 26 19:03:36.951872 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] calling os-brick to detach iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jan 26 19:03:36.952542 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971', 'target_lun': 0, 'volume_id': '3efb2e02-7cf8-4a53-8773-43cb3f187971', 'auth_method': 'CHAP', 'auth_username': 'FKfDNeAt56LA3MMZ5ghZ', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sda'}, None), 'kwargs': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:03:36.952710 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:03:36.953135 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:03:36.954895 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:36.962812 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:36.963604 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef2b1e7-a66f-4dc1-9092-8c8c1caf210d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:03:36.963925 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:03:36.963925 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:03:36.963925 np0005596550.novalocal nova-compute[189076]: iSNS: Jan 26 19:03:36.963925 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:03:36.963925 np0005596550.novalocal nova-compute[189076]: STATIC: Jan 26 19:03:36.963925 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 Jan 26 19:03:36.963925 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:03:36.963925 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:03:36.963925 np0005596550.novalocal nova-compute[189076]: FIRMWARE: Jan 26 19:03:36.963925 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:03:36.963925 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:03:36.964073 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:03:36.964073 np0005596550.novalocal nova-compute[189076]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:03:36.964073 np0005596550.novalocal nova-compute[189076]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=189076) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:03:36.964287 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971', 0)] {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:03:36.964989 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:36.972086 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:36.972203 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e59aa7c-0680-4429-894b-6f41f0ce1a12]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:03:36.973125 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:36.983032 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:36.983129 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a427037-78c1-4fea-95f1-5bc8c384afa4]: (4, ('tcp: [6] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:03:36.983441 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 (non-flash) Jan 26 19:03:36.983441 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:03:36.983616 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsi session list stdout=tcp: [6] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 (non-flash) Jan 26 19:03:36.983616 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:03:36.984139 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Resulting device map defaultdict(. at 0x7fd7684ab2e0>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971'): ({'sda'}, set())}) {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:03:36.984332 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Removing single pathed devices sda {{(pid=189076) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:03:36.984996 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:36.990785 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:03:36.992128 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[561e3f84-b044-42de-a1d8-f3ce73176a5b]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:03:36.992128 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:03:36.992128 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:03:36.992128 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:03:36.992128 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:03:36.992128 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:03:36.992128 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:03:36.992128 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:03:36.992128 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:03:36.992128 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:03:36.992128 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:03:36.992128 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:03:36.992128 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:03:36.992128 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:03:36.992128 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:03:36.992128 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:03:36.992128 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:03:36.992128 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:03:36.992128 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:03:36.992128 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:03:36.992128 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:03:36.992128 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:03:36.993167 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[561e3f84-b044-42de-a1d8-f3ce73176a5b]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:03:36.993684 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Flushing IO for device /dev/sda {{(pid=189076) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:03:36.994259 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sda {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:37.001629 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sda" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:37.001801 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[8297c883-f182-4fd6-b946-19ff385ac0a6]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:03:37.002150 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Remove SCSI device /dev/sda with /sys/block/sda/device/delete {{(pid=189076) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:03:37.005240 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sda/device/delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:37.051047 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sda/device/delete" returned: 0 in 0.048s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:37.051211 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[74057239-7789-4fd7-87d1-816b947fbba2]: (4, ('1', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:03:37.051580 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Checking to see if SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:03:37.051746 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:03:37.052071 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971')] {{(pid=189076) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:03:37.052831 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:37.061032 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:37.061140 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[1554a980-b9b5-4403-ba37-d8d4e5f7b3b3]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:03:37.061658 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:03:37.064044 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --logout {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:37.097502 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --logout" returned: 0 in 0.029s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:37.097652 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea34628a-e9d1-473a-830d-7c34635c0d07]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971, portal: 38.102.83.18,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:03:37.099028 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971, portal: 38.102.83.18,3260] Jan 26 19:03:37.099028 np0005596550.novalocal nova-compute[189076]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971, portal: 38.102.83.18,3260] successful. Jan 26 19:03:37.099028 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:03:37.100404 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --op delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:37.110498 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3efb2e02-7cf8-4a53-8773-43cb3f187971 -p 38.102.83.18:3260 --op delete" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:37.110648 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54aa421-4cb9-472d-95e1-99fea6544d09]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:03:37.111071 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:03:37.111584 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.158s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:03:37.111809 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] <== disconnect_volume: return (159ms) None {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:03:37.112054 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Disconnected iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jan 26 19:03:37.112522 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Deleting instance files /opt/stack/data/nova/instances/c61cafe4-53dc-4f97-95ce-7920f42bc548_del Jan 26 19:03:37.113038 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Deletion of /opt/stack/data/nova/instances/c61cafe4-53dc-4f97-95ce-7920f42bc548_del complete Jan 26 19:03:37.279293 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Object Instance<7c928a35-c5a7-45e1-9e9b-9ea987610ad5> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:03:37.281974 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError Jan 26 19:03:37.368619 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Creating config drive at /opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5/disk.config Jan 26 19:03:37.371793 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpqb5sejif {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:37.497390 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpqb5sejif" returned: 0 in 0.124s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:37.607884 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:03:37.611447 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:37.622560 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:37.631567 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Took 1.51 seconds to destroy the instance on the hypervisor. Jan 26 19:03:37.632610 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:03:37.632610 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:03:37.634700 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:03:37.636361 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:03:37.716162 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:03:37.785723 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:37.787911 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:37.820652 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for 7c928a35-c5a7-45e1-9e9b-9ea987610ad5 due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:03:37.822197 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:03:37.822403 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] VM Resumed (Lifecycle Event) Jan 26 19:03:37.824123 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Instance event wait completed in 0 seconds for {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:03:37.825349 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:03:37.830468 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Instance spawned successfully. Jan 26 19:03:37.830725 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:03:38.133506 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] instance snapshotting Jan 26 19:03:38.134147 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'flavor' on Instance uuid ca9a34ab-50c7-4278-b247-c7a7baeb5968 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:03:38.174087 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b6b6f4eb-aab0-4dc5-baf2-e6301e912a17 req-81fe33dd-8511-469d-83d7-b628b13a262a service nova] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Received event network-vif-deleted-36f759b4-c422-4e36-890d-adda38033305 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:03:38.174388 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-b6b6f4eb-aab0-4dc5-baf2-e6301e912a17 req-81fe33dd-8511-469d-83d7-b628b13a262a service nova] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Neutron deleted interface 36f759b4-c422-4e36-890d-adda38033305; detaching it from the instance and deleting it from the info cache Jan 26 19:03:38.174567 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-b6b6f4eb-aab0-4dc5-baf2-e6301e912a17 req-81fe33dd-8511-469d-83d7-b628b13a262a service nova] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:03:38.327561 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:03:38.331361 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:03:38.343280 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:03:38.343720 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:03:38.344925 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:03:38.345914 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:03:38.347164 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:03:38.348599 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:03:38.362421 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4ac6ff77-5489-4a6a-8fdb-a1af17a465ed req-824ec544-7072-4307-82bd-b48c04c10644 service nova] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Received event network-vif-unplugged-36f759b4-c422-4e36-890d-adda38033305 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:03:38.363387 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4ac6ff77-5489-4a6a-8fdb-a1af17a465ed req-824ec544-7072-4307-82bd-b48c04c10644 service nova] Acquiring lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:38.363387 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4ac6ff77-5489-4a6a-8fdb-a1af17a465ed req-824ec544-7072-4307-82bd-b48c04c10644 service nova] Lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:38.363387 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4ac6ff77-5489-4a6a-8fdb-a1af17a465ed req-824ec544-7072-4307-82bd-b48c04c10644 service nova] Lock "c61cafe4-53dc-4f97-95ce-7920f42bc548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:38.363387 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4ac6ff77-5489-4a6a-8fdb-a1af17a465ed req-824ec544-7072-4307-82bd-b48c04c10644 service nova] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] No waiting events found dispatching network-vif-unplugged-36f759b4-c422-4e36-890d-adda38033305 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:03:38.363553 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4ac6ff77-5489-4a6a-8fdb-a1af17a465ed req-824ec544-7072-4307-82bd-b48c04c10644 service nova] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Received event network-vif-unplugged-36f759b4-c422-4e36-890d-adda38033305 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:03:38.363823 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4ac6ff77-5489-4a6a-8fdb-a1af17a465ed req-824ec544-7072-4307-82bd-b48c04c10644 service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Received event network-vif-plugged-945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:03:38.364018 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4ac6ff77-5489-4a6a-8fdb-a1af17a465ed req-824ec544-7072-4307-82bd-b48c04c10644 service nova] Acquiring lock "7c928a35-c5a7-45e1-9e9b-9ea987610ad5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:38.364237 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4ac6ff77-5489-4a6a-8fdb-a1af17a465ed req-824ec544-7072-4307-82bd-b48c04c10644 service nova] Lock "7c928a35-c5a7-45e1-9e9b-9ea987610ad5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:38.364908 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4ac6ff77-5489-4a6a-8fdb-a1af17a465ed req-824ec544-7072-4307-82bd-b48c04c10644 service nova] Lock "7c928a35-c5a7-45e1-9e9b-9ea987610ad5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:38.364908 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4ac6ff77-5489-4a6a-8fdb-a1af17a465ed req-824ec544-7072-4307-82bd-b48c04c10644 service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] No waiting events found dispatching network-vif-plugged-945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:03:38.365207 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-4ac6ff77-5489-4a6a-8fdb-a1af17a465ed req-824ec544-7072-4307-82bd-b48c04c10644 service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Received unexpected event network-vif-plugged-945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97 for instance with vm_state active and task_state rebuild_spawning. Jan 26 19:03:38.365485 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4ac6ff77-5489-4a6a-8fdb-a1af17a465ed req-824ec544-7072-4307-82bd-b48c04c10644 service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Received event network-vif-plugged-945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:03:38.365643 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4ac6ff77-5489-4a6a-8fdb-a1af17a465ed req-824ec544-7072-4307-82bd-b48c04c10644 service nova] Acquiring lock "7c928a35-c5a7-45e1-9e9b-9ea987610ad5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:38.365866 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4ac6ff77-5489-4a6a-8fdb-a1af17a465ed req-824ec544-7072-4307-82bd-b48c04c10644 service nova] Lock "7c928a35-c5a7-45e1-9e9b-9ea987610ad5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:38.366185 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4ac6ff77-5489-4a6a-8fdb-a1af17a465ed req-824ec544-7072-4307-82bd-b48c04c10644 service nova] Lock "7c928a35-c5a7-45e1-9e9b-9ea987610ad5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:38.366442 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4ac6ff77-5489-4a6a-8fdb-a1af17a465ed req-824ec544-7072-4307-82bd-b48c04c10644 service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] No waiting events found dispatching network-vif-plugged-945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:03:38.366648 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-4ac6ff77-5489-4a6a-8fdb-a1af17a465ed req-824ec544-7072-4307-82bd-b48c04c10644 service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Received unexpected event network-vif-plugged-945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97 for instance with vm_state active and task_state rebuild_spawning. Jan 26 19:03:38.658204 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:03:38.679755 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b6b6f4eb-aab0-4dc5-baf2-e6301e912a17 req-81fe33dd-8511-469d-83d7-b628b13a262a service nova] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Detach interface failed, port_id=36f759b4-c422-4e36-890d-adda38033305, reason: Instance c61cafe4-53dc-4f97-95ce-7920f42bc548 could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:03:38.720402 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Beginning live snapshot process Jan 26 19:03:38.838844 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] During sync_power_state the instance has a pending task (rebuild_spawning). Skip. Jan 26 19:03:38.839328 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:03:38.839328 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] VM Started (Lifecycle Event) Jan 26 19:03:38.854223 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:03:39.161451 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Took 1.53 seconds to deallocate network for instance. Jan 26 19:03:39.342593 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:03:39.346690 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:03:39.364405 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:39.364540 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:39.364590 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Trying to apply a migration context that does not seem to be set for this instance {{(pid=189076) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}} Jan 26 19:03:40.235492 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json -f qcow2 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:40.307736 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json -f qcow2" returned: 0 in 0.072s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:40.308115 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json -f qcow2 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:40.375027 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-41500859-0bc0-47ba-8cc9-54cf924b0ef4 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.010s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:40.381858 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json -f qcow2" returned: 0 in 0.074s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:40.382567 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:03:40.388640 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:03:40.389177 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:40.460957 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.071s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:40.461302 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmph50vx3py/618e215f25ec438fbeb98f268f009def.delta 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:40.487697 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmph50vx3py/618e215f25ec438fbeb98f268f009def.delta 1073741824" returned: 0 in 0.026s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:40.488025 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Quiescing instance not available: QEMU guest agent is not enabled. Jan 26 19:03:40.522908 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] COPY block job progress, current cursor: 0 final cursor: 76611584 {{(pid=189076) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:845}} Jan 26 19:03:41.025451 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] COPY block job progress, current cursor: 76611584 final cursor: 76611584 {{(pid=189076) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:845}} Jan 26 19:03:41.028491 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Skipping quiescing instance: QEMU guest agent is not enabled. Jan 26 19:03:41.060025 np0005596550.novalocal nova-compute[189076]: DEBUG nova.privsep.utils [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=189076) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jan 26 19:03:41.060307 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmph50vx3py/618e215f25ec438fbeb98f268f009def.delta /opt/stack/data/nova/instances/snapshots/tmph50vx3py/618e215f25ec438fbeb98f268f009def {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:41.545930 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmph50vx3py/618e215f25ec438fbeb98f268f009def.delta /opt/stack/data/nova/instances/snapshots/tmph50vx3py/618e215f25ec438fbeb98f268f009def" returned: 0 in 0.485s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:41.548498 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Snapshot extracted, beginning image upload Jan 26 19:03:41.954937 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:42.239987 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Took 3.08 seconds to detach 1 volumes for instance. Jan 26 19:03:42.241654 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Deleting volume: 3efb2e02-7cf8-4a53-8773-43cb3f187971 {{(pid=189076) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3343}} Jan 26 19:03:42.809005 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:42.809366 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:43.064891 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:03:43.568335 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:03:44.079882 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.270s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:44.192583 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Deleted allocations for instance c61cafe4-53dc-4f97-95ce-7920f42bc548 Jan 26 19:03:44.257791 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Snapshot image upload complete Jan 26 19:03:44.258103 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Took 5.62 seconds to snapshot the instance on the hypervisor. Jan 26 19:03:44.881623 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-7d822d43-b0e5-4e98-98b2-d2dbba524abb tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Found 1 images (rotation: 2) {{(pid=189076) _rotate_backups /opt/stack/nova/nova/compute/manager.py:5098}} Jan 26 19:03:45.219921 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ee56288a-9873-435d-86ad-59282a5a13ac tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "c61cafe4-53dc-4f97-95ce-7920f42bc548" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 9.611s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:45.551083 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:03:46.061890 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] instance snapshotting Jan 26 19:03:46.062389 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'flavor' on Instance uuid ca9a34ab-50c7-4278-b247-c7a7baeb5968 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:03:46.210912 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Acquiring lock "641862e8-df87-43f7-8022-ccdc6701e4ae" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:46.211160 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "641862e8-df87-43f7-8022-ccdc6701e4ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:46.211414 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Acquiring lock "641862e8-df87-43f7-8022-ccdc6701e4ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:46.211587 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "641862e8-df87-43f7-8022-ccdc6701e4ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:46.211735 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "641862e8-df87-43f7-8022-ccdc6701e4ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:46.214511 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: 641862e8-df87-43f7-8022-ccdc6701e4ae] Terminating instance Jan 26 19:03:46.626588 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Beginning live snapshot process Jan 26 19:03:46.718328 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: 641862e8-df87-43f7-8022-ccdc6701e4ae] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:03:46.753471 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:46.906903 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:46.915401 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:46.941075 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:46.949325 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:46.953808 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-fbf2f987-20bc-4f94-b128-63ce0a5ef6a8 req-808444fb-6f0a-451c-bfd2-85e2c489459f service nova] [instance: 641862e8-df87-43f7-8022-ccdc6701e4ae] Received event network-vif-unplugged-c0f27ab1-beef-40e5-9140-ead0a17fa5b3 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:03:46.953808 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fbf2f987-20bc-4f94-b128-63ce0a5ef6a8 req-808444fb-6f0a-451c-bfd2-85e2c489459f service nova] Acquiring lock "641862e8-df87-43f7-8022-ccdc6701e4ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:46.953808 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fbf2f987-20bc-4f94-b128-63ce0a5ef6a8 req-808444fb-6f0a-451c-bfd2-85e2c489459f service nova] Lock "641862e8-df87-43f7-8022-ccdc6701e4ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:46.953808 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fbf2f987-20bc-4f94-b128-63ce0a5ef6a8 req-808444fb-6f0a-451c-bfd2-85e2c489459f service nova] Lock "641862e8-df87-43f7-8022-ccdc6701e4ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:46.953941 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-fbf2f987-20bc-4f94-b128-63ce0a5ef6a8 req-808444fb-6f0a-451c-bfd2-85e2c489459f service nova] [instance: 641862e8-df87-43f7-8022-ccdc6701e4ae] No waiting events found dispatching network-vif-unplugged-c0f27ab1-beef-40e5-9140-ead0a17fa5b3 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:03:46.954360 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-fbf2f987-20bc-4f94-b128-63ce0a5ef6a8 req-808444fb-6f0a-451c-bfd2-85e2c489459f service nova] [instance: 641862e8-df87-43f7-8022-ccdc6701e4ae] Received event network-vif-unplugged-c0f27ab1-beef-40e5-9140-ead0a17fa5b3 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:03:46.957963 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:46.989870 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 641862e8-df87-43f7-8022-ccdc6701e4ae] Instance destroyed successfully. Jan 26 19:03:46.990318 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lazy-loading 'resources' on Instance uuid 641862e8-df87-43f7-8022-ccdc6701e4ae {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:03:47.494799 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1820686566',display_name='tempest-ServerActionsTestOtherA-server-1820686566',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestothera-server-1820686566',id=58,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:02:07Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='53f4982d229a4b93921b2b76b5371afa',ramdisk_id='',reservation_id='r-m1ly7qq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-497818938',owner_user_name='tempest-ServerActionsTestOtherA-497818938-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:02:07Z,user_data=None,user_id='bda1caa6deb04a3faafe2ddccc5e5fef',uuid=641862e8-df87-43f7-8022-ccdc6701e4ae,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0f27ab1-beef-40e5-9140-ead0a17fa5b3", "address": "fa:16:3e:28:2e:be", "network": {"id": "b2d9e1cb-f287-433e-b8e1-33c8468fe907", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781104217-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53f4982d229a4b93921b2b76b5371afa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0f27ab1-be", "ovs_interfaceid": "c0f27ab1-beef-40e5-9140-ead0a17fa5b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:03:47.494799 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Converting VIF {"id": "c0f27ab1-beef-40e5-9140-ead0a17fa5b3", "address": "fa:16:3e:28:2e:be", "network": {"id": "b2d9e1cb-f287-433e-b8e1-33c8468fe907", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781104217-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53f4982d229a4b93921b2b76b5371afa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0f27ab1-be", "ovs_interfaceid": "c0f27ab1-beef-40e5-9140-ead0a17fa5b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:03:47.495300 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:2e:be,bridge_name='br-int',has_traffic_filtering=True,id=c0f27ab1-beef-40e5-9140-ead0a17fa5b3,network=Network(b2d9e1cb-f287-433e-b8e1-33c8468fe907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0f27ab1-be') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:03:47.495615 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:2e:be,bridge_name='br-int',has_traffic_filtering=True,id=c0f27ab1-beef-40e5-9140-ead0a17fa5b3,network=Network(b2d9e1cb-f287-433e-b8e1-33c8468fe907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0f27ab1-be') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:03:47.497567 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:47.497902 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0f27ab1-be, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:03:47.539804 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:47.543476 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:47.543476 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:47.543476 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70bbbb83-aa46-4ef0-bbec-19968eefc7ab) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:03:47.543886 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:47.545453 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:47.548472 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:2e:be,bridge_name='br-int',has_traffic_filtering=True,id=c0f27ab1-beef-40e5-9140-ead0a17fa5b3,network=Network(b2d9e1cb-f287-433e-b8e1-33c8468fe907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0f27ab1-be') Jan 26 19:03:47.549112 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: 641862e8-df87-43f7-8022-ccdc6701e4ae] Deleting instance files /opt/stack/data/nova/instances/641862e8-df87-43f7-8022-ccdc6701e4ae_del Jan 26 19:03:47.549883 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: 641862e8-df87-43f7-8022-ccdc6701e4ae] Deletion of /opt/stack/data/nova/instances/641862e8-df87-43f7-8022-ccdc6701e4ae_del complete Jan 26 19:03:48.061665 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: 641862e8-df87-43f7-8022-ccdc6701e4ae] Took 1.34 seconds to destroy the instance on the hypervisor. Jan 26 19:03:48.062331 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:03:48.062331 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 641862e8-df87-43f7-8022-ccdc6701e4ae] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:03:48.063098 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 641862e8-df87-43f7-8022-ccdc6701e4ae] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:03:48.063503 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:03:48.109583 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:03:48.145892 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json -f qcow2 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:48.233638 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json -f qcow2" returned: 0 in 0.088s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:48.234091 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json -f qcow2 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:48.308370 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json -f qcow2" returned: 0 in 0.074s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:48.309018 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:03:48.311706 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:03:48.312117 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:48.397737 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.084s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:48.397737 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprxutldre/a92ab413a93346519c47c1f0c219db0a.delta 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:48.431224 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprxutldre/a92ab413a93346519c47c1f0c219db0a.delta 1073741824" returned: 0 in 0.033s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:48.431578 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Quiescing instance not available: QEMU guest agent is not enabled. Jan 26 19:03:48.482147 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] COPY block job progress, current cursor: 0 final cursor: 76677120 {{(pid=189076) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:845}} Jan 26 19:03:48.845655 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 641862e8-df87-43f7-8022-ccdc6701e4ae] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:03:48.985627 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] COPY block job progress, current cursor: 76677120 final cursor: 76677120 {{(pid=189076) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:845}} Jan 26 19:03:48.988300 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Skipping quiescing instance: QEMU guest agent is not enabled. Jan 26 19:03:49.007415 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-04fae59f-f110-4c71-9bab-179d65f9e3d9 req-819c07bd-e5e9-4471-bc54-47d9388c87ad service nova] [instance: 641862e8-df87-43f7-8022-ccdc6701e4ae] Received event network-vif-unplugged-c0f27ab1-beef-40e5-9140-ead0a17fa5b3 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:03:49.007841 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-04fae59f-f110-4c71-9bab-179d65f9e3d9 req-819c07bd-e5e9-4471-bc54-47d9388c87ad service nova] Acquiring lock "641862e8-df87-43f7-8022-ccdc6701e4ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:49.008207 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-04fae59f-f110-4c71-9bab-179d65f9e3d9 req-819c07bd-e5e9-4471-bc54-47d9388c87ad service nova] Lock "641862e8-df87-43f7-8022-ccdc6701e4ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:49.008402 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-04fae59f-f110-4c71-9bab-179d65f9e3d9 req-819c07bd-e5e9-4471-bc54-47d9388c87ad service nova] Lock "641862e8-df87-43f7-8022-ccdc6701e4ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:49.008573 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-04fae59f-f110-4c71-9bab-179d65f9e3d9 req-819c07bd-e5e9-4471-bc54-47d9388c87ad service nova] [instance: 641862e8-df87-43f7-8022-ccdc6701e4ae] No waiting events found dispatching network-vif-unplugged-c0f27ab1-beef-40e5-9140-ead0a17fa5b3 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:03:49.008805 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-04fae59f-f110-4c71-9bab-179d65f9e3d9 req-819c07bd-e5e9-4471-bc54-47d9388c87ad service nova] [instance: 641862e8-df87-43f7-8022-ccdc6701e4ae] Received event network-vif-unplugged-c0f27ab1-beef-40e5-9140-ead0a17fa5b3 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:03:49.009022 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-04fae59f-f110-4c71-9bab-179d65f9e3d9 req-819c07bd-e5e9-4471-bc54-47d9388c87ad service nova] [instance: 641862e8-df87-43f7-8022-ccdc6701e4ae] Received event network-vif-deleted-c0f27ab1-beef-40e5-9140-ead0a17fa5b3 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:03:49.021938 np0005596550.novalocal nova-compute[189076]: DEBUG nova.privsep.utils [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=189076) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jan 26 19:03:49.022263 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprxutldre/a92ab413a93346519c47c1f0c219db0a.delta /opt/stack/data/nova/instances/snapshots/tmprxutldre/a92ab413a93346519c47c1f0c219db0a {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:49.350039 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 641862e8-df87-43f7-8022-ccdc6701e4ae] Took 1.29 seconds to deallocate network for instance. Jan 26 19:03:49.857747 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:49.858132 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:50.109136 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprxutldre/a92ab413a93346519c47c1f0c219db0a.delta /opt/stack/data/nova/instances/snapshots/tmprxutldre/a92ab413a93346519c47c1f0c219db0a" returned: 0 in 1.086s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:50.111982 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Snapshot extracted, beginning image upload Jan 26 19:03:50.136187 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:03:50.643165 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:03:51.152431 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.293s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:51.203882 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Deleted allocations for instance 641862e8-df87-43f7-8022-ccdc6701e4ae Jan 26 19:03:51.409260 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:03:51.409437 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] VM Stopped (Lifecycle Event) Jan 26 19:03:51.916748 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a7712436-b6c2-4f10-b266-5c8a50f802e4 None None] [instance: c61cafe4-53dc-4f97-95ce-7920f42bc548] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:03:51.959459 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:52.218679 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-62081dd9-c7fa-4db9-9e2f-618833f43d64 tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "641862e8-df87-43f7-8022-ccdc6701e4ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.007s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:52.607333 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:52.809708 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Snapshot image upload complete Jan 26 19:03:52.810186 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Took 6.24 seconds to snapshot the instance on the hypervisor. Jan 26 19:03:52.915456 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Acquiring lock "b75069ad-e74f-4328-9089-5400c8fbc9bf" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:52.915672 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "b75069ad-e74f-4328-9089-5400c8fbc9bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:52.915893 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Acquiring lock "b75069ad-e74f-4328-9089-5400c8fbc9bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:52.916002 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "b75069ad-e74f-4328-9089-5400c8fbc9bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:52.916178 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "b75069ad-e74f-4328-9089-5400c8fbc9bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:52.918567 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: b75069ad-e74f-4328-9089-5400c8fbc9bf] Terminating instance Jan 26 19:03:53.413596 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-705fee26-38e0-4894-902b-639dc130d148 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Found 2 images (rotation: 2) {{(pid=189076) _rotate_backups /opt/stack/nova/nova/compute/manager.py:5098}} Jan 26 19:03:53.422291 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: b75069ad-e74f-4328-9089-5400c8fbc9bf] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:03:53.489497 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:53.492076 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:53.499689 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:53.526627 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:53.541821 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:53.705062 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-fb1286f6-35d0-4ab6-97ff-2bd73bcca45d req-c31cd40f-8f6d-4ac2-9d50-6186c82b2eb0 service nova] [instance: b75069ad-e74f-4328-9089-5400c8fbc9bf] Received event network-vif-unplugged-471e818f-fbe4-419e-bc22-9c7ab32634a5 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:03:53.705453 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fb1286f6-35d0-4ab6-97ff-2bd73bcca45d req-c31cd40f-8f6d-4ac2-9d50-6186c82b2eb0 service nova] Acquiring lock "b75069ad-e74f-4328-9089-5400c8fbc9bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:53.705699 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fb1286f6-35d0-4ab6-97ff-2bd73bcca45d req-c31cd40f-8f6d-4ac2-9d50-6186c82b2eb0 service nova] Lock "b75069ad-e74f-4328-9089-5400c8fbc9bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:53.708831 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fb1286f6-35d0-4ab6-97ff-2bd73bcca45d req-c31cd40f-8f6d-4ac2-9d50-6186c82b2eb0 service nova] Lock "b75069ad-e74f-4328-9089-5400c8fbc9bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:53.708831 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-fb1286f6-35d0-4ab6-97ff-2bd73bcca45d req-c31cd40f-8f6d-4ac2-9d50-6186c82b2eb0 service nova] [instance: b75069ad-e74f-4328-9089-5400c8fbc9bf] No waiting events found dispatching network-vif-unplugged-471e818f-fbe4-419e-bc22-9c7ab32634a5 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:03:53.708831 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-fb1286f6-35d0-4ab6-97ff-2bd73bcca45d req-c31cd40f-8f6d-4ac2-9d50-6186c82b2eb0 service nova] [instance: b75069ad-e74f-4328-9089-5400c8fbc9bf] Received event network-vif-unplugged-471e818f-fbe4-419e-bc22-9c7ab32634a5 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:03:53.713351 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: b75069ad-e74f-4328-9089-5400c8fbc9bf] Instance destroyed successfully. Jan 26 19:03:53.713351 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lazy-loading 'resources' on Instance uuid b75069ad-e74f-4328-9089-5400c8fbc9bf {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:03:54.215519 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:00:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-206780863',display_name='tempest-ServerActionsTestOtherA-server-206780863',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestothera-server-206780863',id=50,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkm/PVAmYQe14oR+m9oifK9GF7IRXRKATSBpMRQ3qYZZ/vFrXZ5EXOuwi6xUe/eQG+fKh0mbpJCQePf/1R2TGvrtb52X0k1pDlW6qTQXyKWpF8WgH7Q3fLblq1m21/gFw==',key_name='tempest-keypair-542846393',keypairs=,launch_index=0,launched_at=2026-01-27T00:00:37Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='53f4982d229a4b93921b2b76b5371afa',ramdisk_id='',reservation_id='r-9iiw0xa3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-497818938',owner_user_name='tempest-ServerActionsTestOtherA-497818938-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bda1caa6deb04a3faafe2ddccc5e5fef',uuid=b75069ad-e74f-4328-9089-5400c8fbc9bf,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "471e818f-fbe4-419e-bc22-9c7ab32634a5", "address": "fa:16:3e:fe:a2:b2", "network": {"id": "b2d9e1cb-f287-433e-b8e1-33c8468fe907", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781104217-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53f4982d229a4b93921b2b76b5371afa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap471e818f-fb", "ovs_interfaceid": "471e818f-fbe4-419e-bc22-9c7ab32634a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:03:54.216233 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Converting VIF {"id": "471e818f-fbe4-419e-bc22-9c7ab32634a5", "address": "fa:16:3e:fe:a2:b2", "network": {"id": "b2d9e1cb-f287-433e-b8e1-33c8468fe907", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781104217-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53f4982d229a4b93921b2b76b5371afa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap471e818f-fb", "ovs_interfaceid": "471e818f-fbe4-419e-bc22-9c7ab32634a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:03:54.216934 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:a2:b2,bridge_name='br-int',has_traffic_filtering=True,id=471e818f-fbe4-419e-bc22-9c7ab32634a5,network=Network(b2d9e1cb-f287-433e-b8e1-33c8468fe907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471e818f-fb') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:03:54.217263 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:a2:b2,bridge_name='br-int',has_traffic_filtering=True,id=471e818f-fbe4-419e-bc22-9c7ab32634a5,network=Network(b2d9e1cb-f287-433e-b8e1-33c8468fe907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471e818f-fb') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:03:54.218669 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:54.218978 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap471e818f-fb, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:03:54.220161 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:54.221354 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:54.222477 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:54.222804 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a584d481-0313-4a7c-8169-82d078790cba) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:03:54.223361 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:54.224582 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:54.227423 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:a2:b2,bridge_name='br-int',has_traffic_filtering=True,id=471e818f-fbe4-419e-bc22-9c7ab32634a5,network=Network(b2d9e1cb-f287-433e-b8e1-33c8468fe907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471e818f-fb') Jan 26 19:03:54.227895 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: b75069ad-e74f-4328-9089-5400c8fbc9bf] Deleting instance files /opt/stack/data/nova/instances/b75069ad-e74f-4328-9089-5400c8fbc9bf_del Jan 26 19:03:54.228558 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: b75069ad-e74f-4328-9089-5400c8fbc9bf] Deletion of /opt/stack/data/nova/instances/b75069ad-e74f-4328-9089-5400c8fbc9bf_del complete Jan 26 19:03:54.741842 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] [instance: b75069ad-e74f-4328-9089-5400c8fbc9bf] Took 1.32 seconds to destroy the instance on the hypervisor. Jan 26 19:03:54.741842 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:03:54.741842 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: b75069ad-e74f-4328-9089-5400c8fbc9bf] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:03:54.741842 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: b75069ad-e74f-4328-9089-5400c8fbc9bf] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:03:54.741842 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:03:54.785813 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:03:54.880408 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:03:55.390680 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] instance snapshotting Jan 26 19:03:55.391222 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'flavor' on Instance uuid ca9a34ab-50c7-4278-b247-c7a7baeb5968 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:03:55.613726 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: b75069ad-e74f-4328-9089-5400c8fbc9bf] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:03:55.749609 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-15ef64f0-ac99-4224-aeb1-60dc4b16e442 req-118a3fe7-8219-44c3-b1bc-d29a40070ebd service nova] [instance: b75069ad-e74f-4328-9089-5400c8fbc9bf] Received event network-vif-unplugged-471e818f-fbe4-419e-bc22-9c7ab32634a5 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:03:55.749907 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-15ef64f0-ac99-4224-aeb1-60dc4b16e442 req-118a3fe7-8219-44c3-b1bc-d29a40070ebd service nova] Acquiring lock "b75069ad-e74f-4328-9089-5400c8fbc9bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:55.750186 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-15ef64f0-ac99-4224-aeb1-60dc4b16e442 req-118a3fe7-8219-44c3-b1bc-d29a40070ebd service nova] Lock "b75069ad-e74f-4328-9089-5400c8fbc9bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:55.750352 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-15ef64f0-ac99-4224-aeb1-60dc4b16e442 req-118a3fe7-8219-44c3-b1bc-d29a40070ebd service nova] Lock "b75069ad-e74f-4328-9089-5400c8fbc9bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:55.750567 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-15ef64f0-ac99-4224-aeb1-60dc4b16e442 req-118a3fe7-8219-44c3-b1bc-d29a40070ebd service nova] [instance: b75069ad-e74f-4328-9089-5400c8fbc9bf] No waiting events found dispatching network-vif-unplugged-471e818f-fbe4-419e-bc22-9c7ab32634a5 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:03:55.750724 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-15ef64f0-ac99-4224-aeb1-60dc4b16e442 req-118a3fe7-8219-44c3-b1bc-d29a40070ebd service nova] [instance: b75069ad-e74f-4328-9089-5400c8fbc9bf] Received event network-vif-unplugged-471e818f-fbe4-419e-bc22-9c7ab32634a5 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:03:55.752433 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-15ef64f0-ac99-4224-aeb1-60dc4b16e442 req-118a3fe7-8219-44c3-b1bc-d29a40070ebd service nova] [instance: b75069ad-e74f-4328-9089-5400c8fbc9bf] Received event network-vif-deleted-471e818f-fbe4-419e-bc22-9c7ab32634a5 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:03:55.976464 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Beginning live snapshot process Jan 26 19:03:56.117749 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: b75069ad-e74f-4328-9089-5400c8fbc9bf] Took 1.38 seconds to deallocate network for instance. Jan 26 19:03:56.627576 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:03:56.627576 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:03:56.778307 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:03:56.962822 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:57.282257 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:03:57.504961 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json -f qcow2 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:57.595566 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json -f qcow2" returned: 0 in 0.090s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:57.596076 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json -f qcow2 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:57.615454 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:57.712243 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json -f qcow2" returned: 0 in 0.116s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:57.712991 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:03:57.719251 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:03:57.719724 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:57.792149 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.164s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:57.812934 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.093s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:57.813378 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf0mcxc_h/4ee147259c7548bb8d05945879813d06.delta 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:57.860419 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Deleted allocations for instance b75069ad-e74f-4328-9089-5400c8fbc9bf Jan 26 19:03:57.866521 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf0mcxc_h/4ee147259c7548bb8d05945879813d06.delta 1073741824" returned: 0 in 0.053s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:57.867051 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Quiescing instance not available: QEMU guest agent is not enabled. Jan 26 19:03:57.929487 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] COPY block job progress, current cursor: 0 final cursor: 76677120 {{(pid=189076) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:845}} Jan 26 19:03:58.433711 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] COPY block job progress, current cursor: 76677120 final cursor: 76677120 {{(pid=189076) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:845}} Jan 26 19:03:58.436002 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Skipping quiescing instance: QEMU guest agent is not enabled. Jan 26 19:03:58.493699 np0005596550.novalocal nova-compute[189076]: DEBUG nova.privsep.utils [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=189076) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jan 26 19:03:58.498814 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf0mcxc_h/4ee147259c7548bb8d05945879813d06.delta /opt/stack/data/nova/instances/snapshots/tmpf0mcxc_h/4ee147259c7548bb8d05945879813d06 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:03:58.880095 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8df98012-01b4-4470-9c8a-2cdbef867cfc tempest-ServerActionsTestOtherA-497818938 tempest-ServerActionsTestOtherA-497818938-project-member] Lock "b75069ad-e74f-4328-9089-5400c8fbc9bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 5.964s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:03:59.224812 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:03:59.540901 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf0mcxc_h/4ee147259c7548bb8d05945879813d06.delta /opt/stack/data/nova/instances/snapshots/tmpf0mcxc_h/4ee147259c7548bb8d05945879813d06" returned: 0 in 1.044s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:03:59.545818 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Snapshot extracted, beginning image upload Jan 26 19:04:01.782332 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:01.896407 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:04:01.896407 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Cleaning up deleted instances {{(pid=189076) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11960}} Jan 26 19:04:01.966531 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:01.985794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:04:01.985794 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 641862e8-df87-43f7-8022-ccdc6701e4ae] VM Stopped (Lifecycle Event) Jan 26 19:04:02.401483 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] There are 0 instances to clean {{(pid=189076) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11969}} Jan 26 19:04:02.488953 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-19a3226f-d12e-465c-a779-8f988d9f5d02 None None] [instance: 641862e8-df87-43f7-8022-ccdc6701e4ae] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:04:04.228815 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:04.680464 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Snapshot image upload complete Jan 26 19:04:04.680678 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Took 8.78 seconds to snapshot the instance on the hypervisor. Jan 26 19:04:05.272738 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Found 3 images (rotation: 2) {{(pid=189076) _rotate_backups /opt/stack/nova/nova/compute/manager.py:5098}} Jan 26 19:04:05.273232 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Rotating out 1 backups {{(pid=189076) _rotate_backups /opt/stack/nova/nova/compute/manager.py:5106}} Jan 26 19:04:05.273232 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-5953822c-6cda-47f4-a019-48eacb711f35 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Deleting image ee4450f7-68e9-4ab1-8251-35e4c3858860 {{(pid=189076) _rotate_backups /opt/stack/nova/nova/compute/manager.py:5111}} Jan 26 19:04:06.350951 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:06.967779 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:08.223153 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:08.707994 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:04:08.708143 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: b75069ad-e74f-4328-9089-5400c8fbc9bf] VM Stopped (Lifecycle Event) Jan 26 19:04:08.895137 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:04:08.895407 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:04:09.214256 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-afc2ac7e-87e5-4978-9352-c946de4c47b7 None None] [instance: b75069ad-e74f-4328-9089-5400c8fbc9bf] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:04:09.230299 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:10.398688 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:04:10.742754 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "d0ddb554-76ed-49a6-a02b-042680eb310d" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:10.743133 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "d0ddb554-76ed-49a6-a02b-042680eb310d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:11.247802 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:04:11.806073 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:11.806664 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:11.812805 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:04:11.812805 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Claim successful on node np0005596550.novalocal Jan 26 19:04:11.897253 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:11.969082 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:12.895923 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:04:13.006290 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:04:13.404181 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:13.510147 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:04:14.019403 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.213s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:14.019925 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:04:14.022433 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.618s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:14.022634 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:14.022784 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:04:14.232439 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:14.528958 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:04:14.529154 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:04:14.529620 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:14.529952 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:14.753026 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8369268788c24337ade1739d948c300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428b9d1e48c42f690612bf1e012ec42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:04:15.031974 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:04:15.066309 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:15.138643 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12/disk --force-share --output=json" returned: 0 in 0.072s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:15.139672 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:15.218007 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:15.221600 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:15.329935 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:15.331778 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:15.417969 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:15.423611 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:15.451970 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Successfully created port: dcf15471-a9ae-4c77-9a75-1665544873d5 {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:04:15.514255 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:15.514668 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:15.536061 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:04:15.621729 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:15.784589 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:04:15.785557 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:15.801140 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.015s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:15.801486 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=7242MB free_disk=373.4014549255371GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:04:15.801682 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:15.801998 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:16.031827 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Successfully updated port: dcf15471-a9ae-4c77-9a75-1665544873d5 {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:04:16.069335 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c2222020-ec89-4183-9841-41737387e3be req-6b4fb550-8879-45fd-8c01-93555810c8b6 service nova] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Received event network-changed-dcf15471-a9ae-4c77-9a75-1665544873d5 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:04:16.069335 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c2222020-ec89-4183-9841-41737387e3be req-6b4fb550-8879-45fd-8c01-93555810c8b6 service nova] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Refreshing instance network info cache due to event network-changed-dcf15471-a9ae-4c77-9a75-1665544873d5. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:04:16.069335 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c2222020-ec89-4183-9841-41737387e3be req-6b4fb550-8879-45fd-8c01-93555810c8b6 service nova] Acquiring lock "refresh_cache-d0ddb554-76ed-49a6-a02b-042680eb310d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:04:16.069335 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c2222020-ec89-4183-9841-41737387e3be req-6b4fb550-8879-45fd-8c01-93555810c8b6 service nova] Acquired lock "refresh_cache-d0ddb554-76ed-49a6-a02b-042680eb310d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:04:16.070279 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-c2222020-ec89-4183-9841-41737387e3be req-6b4fb550-8879-45fd-8c01-93555810c8b6 service nova] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Refreshing network info cache for port dcf15471-a9ae-4c77-9a75-1665544873d5 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:04:16.536211 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "refresh_cache-d0ddb554-76ed-49a6-a02b-042680eb310d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:04:16.551619 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:04:16.553079 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:04:16.553500 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Creating image(s) Jan 26 19:04:16.554018 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:16.554236 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "/opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:16.554888 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "/opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:16.555508 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:04:16.559964 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:04:16.561749 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:16.575875 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-c2222020-ec89-4183-9841-41737387e3be req-6b4fb550-8879-45fd-8c01-93555810c8b6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:16.676413 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.115s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:16.676715 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:16.677091 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:16.677413 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:04:16.680046 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:04:16.680318 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:16.744605 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-c2222020-ec89-4183-9841-41737387e3be req-6b4fb550-8879-45fd-8c01-93555810c8b6 service nova] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:04:16.766893 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.086s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:16.767382 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:16.802485 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk 1073741824" returned: 0 in 0.035s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:16.802840 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.126s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:16.803124 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:16.907795 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.104s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:16.908088 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:04:16.908301 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:16.970322 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:16.977621 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "7c928a35-c5a7-45e1-9e9b-9ea987610ad5" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:16.977934 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "7c928a35-c5a7-45e1-9e9b-9ea987610ad5" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:16.978210 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "7c928a35-c5a7-45e1-9e9b-9ea987610ad5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:16.978453 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "7c928a35-c5a7-45e1-9e9b-9ea987610ad5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:16.978665 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "7c928a35-c5a7-45e1-9e9b-9ea987610ad5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:16.988750 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Terminating instance Jan 26 19:04:16.992987 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:16.993509 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Cannot resize image /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:04:16.994076 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:04:16.994454 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Ensure instance console log exists: /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:04:16.995107 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:16.995534 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:16.995877 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:17.021800 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance d9448760-8b72-4805-9dd0-368ccddaaa12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:04:17.021800 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 7c928a35-c5a7-45e1-9e9b-9ea987610ad5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:04:17.021800 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance ca9a34ab-50c7-4278-b247-c7a7baeb5968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:04:17.021800 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance d0ddb554-76ed-49a6-a02b-042680eb310d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:04:17.021800 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 4 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:04:17.021800 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=1280MB phys_disk=399GB used_disk=4GB total_vcpus=8 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:04:15 up 32 min, 13 users, load average: 5.42, 4.93, 3.51\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '4', 'num_proj_2efcb8570b994820a5956fab4e859054': '2', 'io_workload': '1', 'num_proj_8428b9d1e48c42f690612bf1e012ec42': '2', 'num_vm_building': '1', 'num_task_block_device_mapping': '1'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:04:17.164515 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:04:17.172799 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-c2222020-ec89-4183-9841-41737387e3be req-6b4fb550-8879-45fd-8c01-93555810c8b6 service nova] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:04:17.376651 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:17.497983 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:04:17.529469 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:17.537830 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:17.661156 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:17.669114 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:04:17.672819 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:17.674933 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c2222020-ec89-4183-9841-41737387e3be req-6b4fb550-8879-45fd-8c01-93555810c8b6 service nova] Releasing lock "refresh_cache-d0ddb554-76ed-49a6-a02b-042680eb310d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:04:17.675391 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquired lock "refresh_cache-d0ddb554-76ed-49a6-a02b-042680eb310d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:04:17.675930 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:04:17.777205 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Instance destroyed successfully. Jan 26 19:04:17.777205 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'resources' on Instance uuid 7c928a35-c5a7-45e1-9e9b-9ea987610ad5 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:04:18.176783 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:04:18.177159 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.375s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:18.177159 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:04:18.177212 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Cleaning up deleted instances with incomplete migration {{(pid=189076) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11998}} Jan 26 19:04:18.258958 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:04:18.283530 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-01-27T00:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1105651410',display_name='tempest-ServerActionsTestJSON-server-909849696',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-tempest-common-compute-instance-1105651410',id=62,image_ref='bd70f82e-84e0-4042-ad07-7b834bb8ac38',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODQV+rXrfw6z4KA1yufoNzcuxA8euoqAV8xhNM1eTx32FraaBLNNd+7KSOhxWGb4Se5AscyVYG5OwF824QWYb2Qix2OjY87hMenK3O9pQ0SdEoKcqePuRK0jjvpL4YrRQ==',key_name='tempest-keypair-491827368',keypairs=,launch_index=0,launched_at=2026-01-27T00:03:38Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-ishtpvhj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bd70f82e-84e0-4042-ad07-7b834bb8ac38',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:03:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=7c928a35-c5a7-45e1-9e9b-9ea987610ad5,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97", "address": "fa:16:3e:c0:98:80", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap945f0f2b-c3", "ovs_interfaceid": "945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:04:18.284278 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97", "address": "fa:16:3e:c0:98:80", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap945f0f2b-c3", "ovs_interfaceid": "945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:04:18.285422 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:98:80,bridge_name='br-int',has_traffic_filtering=True,id=945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945f0f2b-c3') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:04:18.285967 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:98:80,bridge_name='br-int',has_traffic_filtering=True,id=945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945f0f2b-c3') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:04:18.288493 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:18.289106 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap945f0f2b-c3, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:18.291225 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:18.293602 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:18.295187 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:18.295641 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c945d82e-4f3c-4565-8a83-4a864d8e5213) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:18.297268 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:18.298733 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:04:18.302874 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:98:80,bridge_name='br-int',has_traffic_filtering=True,id=945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945f0f2b-c3') Jan 26 19:04:18.303503 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Deleting instance files /opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5_del Jan 26 19:04:18.304872 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Deletion of /opt/stack/data/nova/instances/7c928a35-c5a7-45e1-9e9b-9ea987610ad5_del complete Jan 26 19:04:18.416932 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:18.568802 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Updating instance_info_cache with network_info: [{"id": "dcf15471-a9ae-4c77-9a75-1665544873d5", "address": "fa:16:3e:5d:9e:bd", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf15471-a9", "ovs_interfaceid": "dcf15471-a9ae-4c77-9a75-1665544873d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:04:18.828220 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Took 1.33 seconds to destroy the instance on the hypervisor. Jan 26 19:04:18.828710 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:04:18.828947 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:04:18.829058 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:04:18.829306 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:18.885110 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:19.082250 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Releasing lock "refresh_cache-d0ddb554-76ed-49a6-a02b-042680eb310d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:04:19.083013 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Instance network_info: |[{"id": "dcf15471-a9ae-4c77-9a75-1665544873d5", "address": "fa:16:3e:5d:9e:bd", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf15471-a9", "ovs_interfaceid": "dcf15471-a9ae-4c77-9a75-1665544873d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:04:19.085434 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Start _get_guest_xml network_info=[{"id": "dcf15471-a9ae-4c77-9a75-1665544873d5", "address": "fa:16:3e:5d:9e:bd", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf15471-a9", "ovs_interfaceid": "dcf15471-a9ae-4c77-9a75-1665544873d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:04:19.092620 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:04:19.095994 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1127513470', uuid='d0ddb554-76ed-49a6-a02b-042680eb310d'), owner=OwnerMeta(userid='8369268788c24337ade1739d948c300a', username='tempest-ServerActionsTestOtherB-1262198412-project-member', projectid='8428b9d1e48c42f690612bf1e012ec42', projectname='tempest-ServerActionsTestOtherB-1262198412'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dcf15471-a9ae-4c77-9a75-1665544873d5", "address": "fa:16:3e:5d:9e:bd", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf15471-a9", "ovs_interfaceid": "dcf15471-a9ae-4c77-9a75-1665544873d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472259.0937057) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:04:19.096627 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:04:19.097410 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:04:19.098668 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:04:19.099149 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:04:19.100315 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:04:19.100885 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:04:19.101160 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:04:19.101468 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:04:19.101581 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:04:19.101783 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:04:19.102713 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:04:19.103124 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:04:19.103390 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:04:19.103630 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:04:19.104229 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:04:19.104506 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:04:19.108748 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1127513470',display_name='tempest-ServerActionsTestOtherB-server-1127513470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-1127513470',id=64,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-yd3sg8h4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:04:15Z,user_data=None,user_id='8369268788c24337ade1739d948c300a',uuid=d0ddb554-76ed-49a6-a02b-042680eb310d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcf15471-a9ae-4c77-9a75-1665544873d5", "address": "fa:16:3e:5d:9e:bd", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf15471-a9", "ovs_interfaceid": "dcf15471-a9ae-4c77-9a75-1665544873d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:04:19.109045 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "dcf15471-a9ae-4c77-9a75-1665544873d5", "address": "fa:16:3e:5d:9e:bd", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf15471-a9", "ovs_interfaceid": "dcf15471-a9ae-4c77-9a75-1665544873d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:04:19.109888 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9e:bd,bridge_name='br-int',has_traffic_filtering=True,id=dcf15471-a9ae-4c77-9a75-1665544873d5,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcf15471-a9') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:04:19.110704 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'pci_devices' on Instance uuid d0ddb554-76ed-49a6-a02b-042680eb310d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] End _get_guest_xml xml= Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: d0ddb554-76ed-49a6-a02b-042680eb310d Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: instance-00000040 Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-server-1127513470 Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:04:19 Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-1262198412-project-member Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-1262198412 Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: d0ddb554-76ed-49a6-a02b-042680eb310d Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: d0ddb554-76ed-49a6-a02b-042680eb310d Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:19.617512 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:04:19.625823 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Preparing to wait for external event network-vif-plugged-dcf15471-a9ae-4c77-9a75-1665544873d5 {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:04:19.625823 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "d0ddb554-76ed-49a6-a02b-042680eb310d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:19.625823 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "d0ddb554-76ed-49a6-a02b-042680eb310d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:19.625823 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "d0ddb554-76ed-49a6-a02b-042680eb310d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:19.625823 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1127513470',display_name='tempest-ServerActionsTestOtherB-server-1127513470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-1127513470',id=64,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-yd3sg8h4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:04:15Z,user_data=None,user_id='8369268788c24337ade1739d948c300a',uuid=d0ddb554-76ed-49a6-a02b-042680eb310d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcf15471-a9ae-4c77-9a75-1665544873d5", "address": "fa:16:3e:5d:9e:bd", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf15471-a9", "ovs_interfaceid": "dcf15471-a9ae-4c77-9a75-1665544873d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:04:19.629809 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "dcf15471-a9ae-4c77-9a75-1665544873d5", "address": "fa:16:3e:5d:9e:bd", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf15471-a9", "ovs_interfaceid": "dcf15471-a9ae-4c77-9a75-1665544873d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:04:19.629809 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9e:bd,bridge_name='br-int',has_traffic_filtering=True,id=dcf15471-a9ae-4c77-9a75-1665544873d5,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcf15471-a9') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:04:19.629809 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9e:bd,bridge_name='br-int',has_traffic_filtering=True,id=dcf15471-a9ae-4c77-9a75-1665544873d5,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcf15471-a9') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:04:19.630876 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:19.631547 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:19.632671 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:04:19.634395 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:19.635279 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f7e1498e-fca1-5d90-b6a2-b1905bbd169d', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:19.640196 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:19.644239 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:04:19.650827 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:19.652928 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcf15471-a9, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:19.652928 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdcf15471-a9, col_values=(('qos', UUID('27c4fc7f-0f7b-4a37-886c-5b53bfcaaa09')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:19.653262 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdcf15471-a9, col_values=(('external_ids', {'iface-id': 'dcf15471-a9ae-4c77-9a75-1665544873d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:9e:bd', 'vm-uuid': 'd0ddb554-76ed-49a6-a02b-042680eb310d'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:19.656342 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:19.660584 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:04:19.664626 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:19.666828 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9e:bd,bridge_name='br-int',has_traffic_filtering=True,id=dcf15471-a9ae-4c77-9a75-1665544873d5,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcf15471-a9') Jan 26 19:04:19.699900 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:04:19.699900 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:04:19.699900 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:04:19.699900 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:04:19.699900 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:04:19.699900 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:04:20.042830 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-14b81618-fd58-4134-a3c7-6afc2d4f1f7f req-e30e3599-3a22-44f0-babc-8be31f392eb7 service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Received event network-vif-deleted-945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:04:20.044421 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-14b81618-fd58-4134-a3c7-6afc2d4f1f7f req-e30e3599-3a22-44f0-babc-8be31f392eb7 service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Neutron deleted interface 945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97; detaching it from the instance and deleting it from the info cache Jan 26 19:04:20.044753 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-14b81618-fd58-4134-a3c7-6afc2d4f1f7f req-e30e3599-3a22-44f0-babc-8be31f392eb7 service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:04:20.282155 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:04:20.551462 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-14b81618-fd58-4134-a3c7-6afc2d4f1f7f req-e30e3599-3a22-44f0-babc-8be31f392eb7 service nova] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Detach interface failed, port_id=945f0f2b-c317-4b7c-b9fa-08e7c8d1cc97, reason: Instance 7c928a35-c5a7-45e1-9e9b-9ea987610ad5 could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:04:20.787028 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Took 1.96 seconds to deallocate network for instance. Jan 26 19:04:21.196958 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:04:21.197150 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:04:21.197370 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No VIF found with MAC fa:16:3e:5d:9e:bd, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:04:21.198068 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Using config drive Jan 26 19:04:21.297370 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:21.297951 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:21.486587 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:04:21.705280 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:21.810246 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Creating config drive at /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk.config Jan 26 19:04:21.813811 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpkp7p3x8i {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:21.944949 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpkp7p3x8i" returned: 0 in 0.130s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:21.972484 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:21.994681 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:04:22.046167 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:22.049158 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:22.056004 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:22.194462 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:22.196449 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:22.217440 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ccb61c56-4e86-499d-93db-fe23801303cf req-d2ec9e88-f657-4824-ab69-50139e03bf47 service nova] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Received event network-vif-plugged-dcf15471-a9ae-4c77-9a75-1665544873d5 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:04:22.217649 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ccb61c56-4e86-499d-93db-fe23801303cf req-d2ec9e88-f657-4824-ab69-50139e03bf47 service nova] Acquiring lock "d0ddb554-76ed-49a6-a02b-042680eb310d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:22.218052 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ccb61c56-4e86-499d-93db-fe23801303cf req-d2ec9e88-f657-4824-ab69-50139e03bf47 service nova] Lock "d0ddb554-76ed-49a6-a02b-042680eb310d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:22.218227 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ccb61c56-4e86-499d-93db-fe23801303cf req-d2ec9e88-f657-4824-ab69-50139e03bf47 service nova] Lock "d0ddb554-76ed-49a6-a02b-042680eb310d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:22.218367 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ccb61c56-4e86-499d-93db-fe23801303cf req-d2ec9e88-f657-4824-ab69-50139e03bf47 service nova] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Processing event network-vif-plugged-dcf15471-a9ae-4c77-9a75-1665544873d5 {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:04:22.226365 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:04:22.226556 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] VM Started (Lifecycle Event) Jan 26 19:04:22.229598 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:04:22.238844 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:04:22.242638 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Instance spawned successfully. Jan 26 19:04:22.242944 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:04:22.509418 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.211s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:22.733346 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:04:22.739541 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:04:22.754813 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:04:22.754813 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:04:22.754991 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:04:22.755521 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:04:22.756145 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:04:22.756879 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:04:22.933756 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Deleted allocations for instance 7c928a35-c5a7-45e1-9e9b-9ea987610ad5 Jan 26 19:04:23.245799 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:04:23.245799 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:04:23.245799 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] VM Paused (Lifecycle Event) Jan 26 19:04:23.371379 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Acquiring lock "2305cb8a-e8df-49d9-b208-018af3c736f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:23.371379 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Lock "2305cb8a-e8df-49d9-b208-018af3c736f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:23.749466 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:04:23.753625 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:04:23.753793 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] VM Resumed (Lifecycle Event) Jan 26 19:04:23.764218 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Took 7.21 seconds to spawn the instance on the hypervisor. Jan 26 19:04:23.764519 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:04:23.874032 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:04:23.950296 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-32c89f19-b3fc-4aca-ab4d-431b284a90e3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "7c928a35-c5a7-45e1-9e9b-9ea987610ad5" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.972s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:24.253802 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6ab91134-b86c-41a6-b9cc-45f143634175 req-231b56fd-3275-460d-834a-609687a0ebad service nova] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Received event network-vif-plugged-dcf15471-a9ae-4c77-9a75-1665544873d5 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:04:24.254295 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6ab91134-b86c-41a6-b9cc-45f143634175 req-231b56fd-3275-460d-834a-609687a0ebad service nova] Acquiring lock "d0ddb554-76ed-49a6-a02b-042680eb310d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:24.254610 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6ab91134-b86c-41a6-b9cc-45f143634175 req-231b56fd-3275-460d-834a-609687a0ebad service nova] Lock "d0ddb554-76ed-49a6-a02b-042680eb310d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:24.254916 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6ab91134-b86c-41a6-b9cc-45f143634175 req-231b56fd-3275-460d-834a-609687a0ebad service nova] Lock "d0ddb554-76ed-49a6-a02b-042680eb310d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:24.255188 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6ab91134-b86c-41a6-b9cc-45f143634175 req-231b56fd-3275-460d-834a-609687a0ebad service nova] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] No waiting events found dispatching network-vif-plugged-dcf15471-a9ae-4c77-9a75-1665544873d5 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:04:24.255482 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-6ab91134-b86c-41a6-b9cc-45f143634175 req-231b56fd-3275-460d-834a-609687a0ebad service nova] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Received unexpected event network-vif-plugged-dcf15471-a9ae-4c77-9a75-1665544873d5 for instance with vm_state active and task_state None. Jan 26 19:04:24.258007 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:04:24.261659 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:04:24.275697 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Took 12.52 seconds to build instance. Jan 26 19:04:24.434148 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:24.434999 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:24.443883 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:04:24.443883 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Claim successful on node np0005596550.novalocal Jan 26 19:04:24.656498 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:24.778294 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7e5dd4cc-6b3f-4a2b-9dd7-19411f8ae733 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "d0ddb554-76ed-49a6-a02b-042680eb310d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.035s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:24.828792 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-2625f707-9473-4fb4-b6d5-4903150ae1b2 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Get console output Jan 26 19:04:24.835439 np0005596550.novalocal nova-compute[189076]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes Jan 26 19:04:25.510177 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Refreshing inventories for resource provider f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}} Jan 26 19:04:25.541636 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Updating ProviderTree inventory for provider f627156c-932e-4a32-97b3-315a994a2ac9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}} Jan 26 19:04:25.541808 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Updating inventory in ProviderTree for provider f627156c-932e-4a32-97b3-315a994a2ac9 with inventory: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jan 26 19:04:25.569084 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Refreshing aggregate associations for resource provider f627156c-932e-4a32-97b3-315a994a2ac9, aggregates: None {{(pid=189076) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}} Jan 26 19:04:25.609600 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Refreshing trait associations for resource provider f627156c-932e-4a32-97b3-315a994a2ac9, traits: COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_ADDRESS_SPACE_EMULATED,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOUND_MODEL_SB16,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_IGB,HW_ARCH_X86_64,COMPUTE_ARCH_X86_64,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_SECURITY_STATELESS_FIRMWARE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOUND_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOUND_MODEL_AC97,COMPUTE_SOUND_MODEL_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ADDRESS_SPACE_PASSTHROUGH {{(pid=189076) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}} Jan 26 19:04:25.851465 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:04:26.355723 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:04:26.395377 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-1c758e5f-1d8e-46b4-82fe-c3a9e9dc45c2 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Get console output Jan 26 19:04:26.408451 np0005596550.novalocal nova-compute[189076]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes Jan 26 19:04:26.509574 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:26.871597 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.437s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:26.872130 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:04:26.974718 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:27.258404 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Stashing vm_state: active {{(pid=189076) _prep_resize /opt/stack/nova/nova/compute/manager.py:6217}} Jan 26 19:04:27.380342 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:04:27.380552 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:04:27.381028 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:27.381310 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:27.495795 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21be6ea60d71454ba2ed6d100e93abf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f25df9dbf944a6885f4c9d7a4f66e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:04:27.797128 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:27.797309 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:27.896930 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:04:27.985477 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-21f96e90-8c38-4dc9-be27-2fae97d18a42 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Get console output Jan 26 19:04:27.993464 np0005596550.novalocal nova-compute[189076]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes Jan 26 19:04:28.064174 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Successfully created port: 21ce5587-15cf-45c6-8f6e-7a9b1f201921 {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:04:28.304752 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:04:28.307836 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Claim successful on node np0005596550.novalocal Jan 26 19:04:28.418359 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:04:28.582880 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Successfully updated port: 21ce5587-15cf-45c6-8f6e-7a9b1f201921 {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:04:28.605855 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-698dfcba-1bde-4f0c-98ae-398cb292c72c req-2ad4c71f-f7a4-4b57-90f3-43025e347d1f service nova] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Received event network-changed-21ce5587-15cf-45c6-8f6e-7a9b1f201921 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:04:28.605855 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-698dfcba-1bde-4f0c-98ae-398cb292c72c req-2ad4c71f-f7a4-4b57-90f3-43025e347d1f service nova] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Refreshing instance network info cache due to event network-changed-21ce5587-15cf-45c6-8f6e-7a9b1f201921. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:04:28.605940 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-698dfcba-1bde-4f0c-98ae-398cb292c72c req-2ad4c71f-f7a4-4b57-90f3-43025e347d1f service nova] Acquiring lock "refresh_cache-2305cb8a-e8df-49d9-b208-018af3c736f0" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:04:28.606072 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-698dfcba-1bde-4f0c-98ae-398cb292c72c req-2ad4c71f-f7a4-4b57-90f3-43025e347d1f service nova] Acquired lock "refresh_cache-2305cb8a-e8df-49d9-b208-018af3c736f0" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:04:28.606227 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-698dfcba-1bde-4f0c-98ae-398cb292c72c req-2ad4c71f-f7a4-4b57-90f3-43025e347d1f service nova] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Refreshing network info cache for port 21ce5587-15cf-45c6-8f6e-7a9b1f201921 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:04:28.816277 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.resource_tracker [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Updating resource usage from migration ba0fda27-2dcc-44f5-b424-1e322a8c9780 Jan 26 19:04:28.913282 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-82b5a1aa-fc21-452b-b9a0-a538d33d3a28 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Getting vnc console {{(pid=189076) get_vnc_console /opt/stack/nova/nova/compute/manager.py:7870}} Jan 26 19:04:29.019621 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:04:29.088134 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Acquiring lock "refresh_cache-2305cb8a-e8df-49d9-b208-018af3c736f0" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:04:29.112794 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-698dfcba-1bde-4f0c-98ae-398cb292c72c req-2ad4c71f-f7a4-4b57-90f3-43025e347d1f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:29.201521 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-698dfcba-1bde-4f0c-98ae-398cb292c72c req-2ad4c71f-f7a4-4b57-90f3-43025e347d1f service nova] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:04:29.301974 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-698dfcba-1bde-4f0c-98ae-398cb292c72c req-2ad4c71f-f7a4-4b57-90f3-43025e347d1f service nova] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:04:29.446281 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:04:29.447153 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:04:29.447453 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Creating image(s) Jan 26 19:04:29.447872 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Acquiring lock "/opt/stack/data/nova/instances/2305cb8a-e8df-49d9-b208-018af3c736f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:29.448089 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Lock "/opt/stack/data/nova/instances/2305cb8a-e8df-49d9-b208-018af3c736f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:29.448706 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Lock "/opt/stack/data/nova/instances/2305cb8a-e8df-49d9-b208-018af3c736f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:29.449244 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:04:29.451963 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:04:29.452869 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:29.524803 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:04:29.527484 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.075s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:29.528022 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:29.528647 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:29.529208 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:04:29.533199 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:04:29.533746 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:29.578756 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 1.781s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:29.579030 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Migrating Jan 26 19:04:29.657989 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:29.660543 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.127s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:29.660865 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/2305cb8a-e8df-49d9-b208-018af3c736f0/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:29.691658 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/2305cb8a-e8df-49d9-b208-018af3c736f0/disk 1073741824" returned: 0 in 0.031s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:29.691995 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.163s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:29.692261 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:29.766591 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.074s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:29.767136 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2305cb8a-e8df-49d9-b208-018af3c736f0/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:04:29.767497 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2305cb8a-e8df-49d9-b208-018af3c736f0/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:29.805355 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-698dfcba-1bde-4f0c-98ae-398cb292c72c req-2ad4c71f-f7a4-4b57-90f3-43025e347d1f service nova] Releasing lock "refresh_cache-2305cb8a-e8df-49d9-b208-018af3c736f0" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:04:29.806079 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Acquired lock "refresh_cache-2305cb8a-e8df-49d9-b208-018af3c736f0" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:04:29.806372 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:04:29.834041 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2305cb8a-e8df-49d9-b208-018af3c736f0/disk --force-share --output=json" returned: 0 in 0.066s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:29.834388 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Cannot resize image /opt/stack/data/nova/instances/2305cb8a-e8df-49d9-b208-018af3c736f0/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:04:29.834789 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:04:29.835081 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Ensure instance console log exists: /opt/stack/data/nova/instances/2305cb8a-e8df-49d9-b208-018af3c736f0/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:04:29.835651 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:29.835950 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:29.836157 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:30.095594 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "refresh_cache-d9448760-8b72-4805-9dd0-368ccddaaa12" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:04:30.095976 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquired lock "refresh_cache-d9448760-8b72-4805-9dd0-368ccddaaa12" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:04:30.095976 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:04:30.367003 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:04:30.598803 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:30.628605 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:30.784410 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Updating instance_info_cache with network_info: [{"id": "21ce5587-15cf-45c6-8f6e-7a9b1f201921", "address": "fa:16:3e:8d:68:9b", "network": {"id": "1c717314-7249-403f-8b3e-1705a2a1d27d", "bridge": "br-int", "label": "tempest-ServerGroupTestJSON-2115004707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f1f25df9dbf944a6885f4c9d7a4f66e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce5587-15", "ovs_interfaceid": "21ce5587-15cf-45c6-8f6e-7a9b1f201921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:04:30.994789 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:31.102250 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Updating instance_info_cache with network_info: [{"id": "72383914-4e53-4d9f-990b-d3cbcdd02186", "address": "fa:16:3e:06:2e:61", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72383914-4e", "ovs_interfaceid": "72383914-4e53-4d9f-990b-d3cbcdd02186", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:04:31.324601 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Releasing lock "refresh_cache-2305cb8a-e8df-49d9-b208-018af3c736f0" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:04:31.324601 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Instance network_info: |[{"id": "21ce5587-15cf-45c6-8f6e-7a9b1f201921", "address": "fa:16:3e:8d:68:9b", "network": {"id": "1c717314-7249-403f-8b3e-1705a2a1d27d", "bridge": "br-int", "label": "tempest-ServerGroupTestJSON-2115004707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f1f25df9dbf944a6885f4c9d7a4f66e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce5587-15", "ovs_interfaceid": "21ce5587-15cf-45c6-8f6e-7a9b1f201921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:04:31.324601 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Start _get_guest_xml network_info=[{"id": "21ce5587-15cf-45c6-8f6e-7a9b1f201921", "address": "fa:16:3e:8d:68:9b", "network": {"id": "1c717314-7249-403f-8b3e-1705a2a1d27d", "bridge": "br-int", "label": "tempest-ServerGroupTestJSON-2115004707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f1f25df9dbf944a6885f4c9d7a4f66e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce5587-15", "ovs_interfaceid": "21ce5587-15cf-45c6-8f6e-7a9b1f201921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:04:31.343966 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:04:31.346305 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerGroupTestJSON-server-652324328', uuid='2305cb8a-e8df-49d9-b208-018af3c736f0'), owner=OwnerMeta(userid='21be6ea60d71454ba2ed6d100e93abf0', username='tempest-ServerGroupTestJSON-824286846-project-member', projectid='f1f25df9dbf944a6885f4c9d7a4f66e7', projectname='tempest-ServerGroupTestJSON-824286846'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "21ce5587-15cf-45c6-8f6e-7a9b1f201921", "address": "fa:16:3e:8d:68:9b", "network": {"id": "1c717314-7249-403f-8b3e-1705a2a1d27d", "bridge": "br-int", "label": "tempest-ServerGroupTestJSON-2115004707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f1f25df9dbf944a6885f4c9d7a4f66e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce5587-15", "ovs_interfaceid": "21ce5587-15cf-45c6-8f6e-7a9b1f201921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472271.3455846) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:04:31.348477 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:04:31.349496 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:04:31.356536 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:04:31.357187 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:04:31.358930 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:04:31.359526 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:04:31.361867 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:04:31.362357 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:04:31.363000 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:04:31.363304 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:04:31.363629 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:04:31.364079 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:04:31.364397 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:04:31.364689 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:04:31.365187 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:04:31.365686 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:04:31.374172 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:04:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerGroupTestJSON-server-652324328',display_name='tempest-ServerGroupTestJSON-server-652324328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-servergrouptestjson-server-652324328',id=65,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1f25df9dbf944a6885f4c9d7a4f66e7',ramdisk_id='',reservation_id='r-d6rtu5dh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerGroupTestJSON-824286846',owner_user_name='tempest-ServerGroupTestJSON-824286846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:04:28Z,user_data=None,user_id='21be6ea60d71454ba2ed6d100e93abf0',uuid=2305cb8a-e8df-49d9-b208-018af3c736f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21ce5587-15cf-45c6-8f6e-7a9b1f201921", "address": "fa:16:3e:8d:68:9b", "network": {"id": "1c717314-7249-403f-8b3e-1705a2a1d27d", "bridge": "br-int", "label": "tempest-ServerGroupTestJSON-2115004707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f1f25df9dbf944a6885f4c9d7a4f66e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce5587-15", "ovs_interfaceid": "21ce5587-15cf-45c6-8f6e-7a9b1f201921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:04:31.374537 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Converting VIF {"id": "21ce5587-15cf-45c6-8f6e-7a9b1f201921", "address": "fa:16:3e:8d:68:9b", "network": {"id": "1c717314-7249-403f-8b3e-1705a2a1d27d", "bridge": "br-int", "label": "tempest-ServerGroupTestJSON-2115004707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f1f25df9dbf944a6885f4c9d7a4f66e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce5587-15", "ovs_interfaceid": "21ce5587-15cf-45c6-8f6e-7a9b1f201921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:04:31.377056 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:68:9b,bridge_name='br-int',has_traffic_filtering=True,id=21ce5587-15cf-45c6-8f6e-7a9b1f201921,network=Network(1c717314-7249-403f-8b3e-1705a2a1d27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ce5587-15') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:04:31.378411 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Lazy-loading 'pci_devices' on Instance uuid 2305cb8a-e8df-49d9-b208-018af3c736f0 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:04:31.384677 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3b8fa861-42f4-4354-bfd5-0775eaa2ef5f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968" by "nova.compute.manager.ComputeManager.stop_instance..do_stop_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:31.385224 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3b8fa861-42f4-4354-bfd5-0775eaa2ef5f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968" acquired by "nova.compute.manager.ComputeManager.stop_instance..do_stop_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:31.385660 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3b8fa861-42f4-4354-bfd5-0775eaa2ef5f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:04:31.391893 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3b8fa861-42f4-4354-bfd5-0775eaa2ef5f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=189076) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3483}} Jan 26 19:04:31.392568 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-3b8fa861-42f4-4354-bfd5-0775eaa2ef5f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'flavor' on Instance uuid ca9a34ab-50c7-4278-b247-c7a7baeb5968 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:04:31.608162 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Releasing lock "refresh_cache-d9448760-8b72-4805-9dd0-368ccddaaa12" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] End _get_guest_xml xml= Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: 2305cb8a-e8df-49d9-b208-018af3c736f0 Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: instance-00000041 Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: tempest-ServerGroupTestJSON-server-652324328 Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:04:31 Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: tempest-ServerGroupTestJSON-824286846-project-member Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: tempest-ServerGroupTestJSON-824286846 Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: 2305cb8a-e8df-49d9-b208-018af3c736f0 Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: 2305cb8a-e8df-49d9-b208-018af3c736f0 Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:31.882726 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:04:31.885074 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Preparing to wait for external event network-vif-plugged-21ce5587-15cf-45c6-8f6e-7a9b1f201921 {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:04:31.885258 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Acquiring lock "2305cb8a-e8df-49d9-b208-018af3c736f0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:31.885444 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Lock "2305cb8a-e8df-49d9-b208-018af3c736f0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:31.885599 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Lock "2305cb8a-e8df-49d9-b208-018af3c736f0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:31.886212 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:04:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerGroupTestJSON-server-652324328',display_name='tempest-ServerGroupTestJSON-server-652324328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-servergrouptestjson-server-652324328',id=65,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1f25df9dbf944a6885f4c9d7a4f66e7',ramdisk_id='',reservation_id='r-d6rtu5dh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerGroupTestJSON-824286846',owner_user_name='tempest-ServerGroupTestJSON-824286846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:04:28Z,user_data=None,user_id='21be6ea60d71454ba2ed6d100e93abf0',uuid=2305cb8a-e8df-49d9-b208-018af3c736f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21ce5587-15cf-45c6-8f6e-7a9b1f201921", "address": "fa:16:3e:8d:68:9b", "network": {"id": "1c717314-7249-403f-8b3e-1705a2a1d27d", "bridge": "br-int", "label": "tempest-ServerGroupTestJSON-2115004707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f1f25df9dbf944a6885f4c9d7a4f66e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce5587-15", "ovs_interfaceid": "21ce5587-15cf-45c6-8f6e-7a9b1f201921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:04:31.886377 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Converting VIF {"id": "21ce5587-15cf-45c6-8f6e-7a9b1f201921", "address": "fa:16:3e:8d:68:9b", "network": {"id": "1c717314-7249-403f-8b3e-1705a2a1d27d", "bridge": "br-int", "label": "tempest-ServerGroupTestJSON-2115004707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f1f25df9dbf944a6885f4c9d7a4f66e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce5587-15", "ovs_interfaceid": "21ce5587-15cf-45c6-8f6e-7a9b1f201921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:04:31.886860 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:68:9b,bridge_name='br-int',has_traffic_filtering=True,id=21ce5587-15cf-45c6-8f6e-7a9b1f201921,network=Network(1c717314-7249-403f-8b3e-1705a2a1d27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ce5587-15') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:04:31.887137 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:68:9b,bridge_name='br-int',has_traffic_filtering=True,id=21ce5587-15cf-45c6-8f6e-7a9b1f201921,network=Network(1c717314-7249-403f-8b3e-1705a2a1d27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ce5587-15') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:04:31.887776 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:31.888143 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:31.888387 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:04:31.889248 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:31.889376 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5aaa9eb3-ff0f-54da-98ad-a0fa712a942a', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:31.890211 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:31.891140 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:04:31.895649 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:31.900462 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:31.900698 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21ce5587-15, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:31.901103 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21ce5587-15, col_values=(('qos', UUID('961afc10-c8e3-4eac-935e-256a3d8698c8')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:31.901275 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21ce5587-15, col_values=(('external_ids', {'iface-id': '21ce5587-15cf-45c6-8f6e-7a9b1f201921', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:68:9b', 'vm-uuid': '2305cb8a-e8df-49d9-b208-018af3c736f0'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:31.902529 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:31.906703 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:04:31.912044 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:31.913055 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:68:9b,bridge_name='br-int',has_traffic_filtering=True,id=21ce5587-15cf-45c6-8f6e-7a9b1f201921,network=Network(1c717314-7249-403f-8b3e-1705a2a1d27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ce5587-15') Jan 26 19:04:31.977008 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:32.466945 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:32.470141 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:32.474209 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:32.592131 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:32.603727 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:32.671975 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c389611b-8167-4c7a-b768-104ddf2c4ae1 req-8304a809-2e75-408e-b5e8-290edb43c50f service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Received event network-vif-unplugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:04:32.671975 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c389611b-8167-4c7a-b768-104ddf2c4ae1 req-8304a809-2e75-408e-b5e8-290edb43c50f service nova] Acquiring lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:32.671975 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c389611b-8167-4c7a-b768-104ddf2c4ae1 req-8304a809-2e75-408e-b5e8-290edb43c50f service nova] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:32.671975 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c389611b-8167-4c7a-b768-104ddf2c4ae1 req-8304a809-2e75-408e-b5e8-290edb43c50f service nova] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:32.671975 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c389611b-8167-4c7a-b768-104ddf2c4ae1 req-8304a809-2e75-408e-b5e8-290edb43c50f service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] No waiting events found dispatching network-vif-unplugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:04:32.671975 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-c389611b-8167-4c7a-b768-104ddf2c4ae1 req-8304a809-2e75-408e-b5e8-290edb43c50f service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Received unexpected event network-vif-unplugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c for instance with vm_state active and task_state powering-off. Jan 26 19:04:32.680677 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Instance destroyed successfully. Jan 26 19:04:32.680985 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-3b8fa861-42f4-4354-bfd5-0775eaa2ef5f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'numa_topology' on Instance uuid ca9a34ab-50c7-4278-b247-c7a7baeb5968 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:04:32.773260 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:04:32.773260 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] VM Stopped (Lifecycle Event) Jan 26 19:04:33.126912 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Starting migrate_disk_and_power_off {{(pid=189076) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12481}} Jan 26 19:04:33.166641 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:33.185156 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-3b8fa861-42f4-4354-bfd5-0775eaa2ef5f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Object Instance lazy-loaded attributes: flavor,numa_topology {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:04:33.185156 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3b8fa861-42f4-4354-bfd5-0775eaa2ef5f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:04:33.192219 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:33.195131 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:33.209416 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:33.278697 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-435c498b-86ce-4bb1-8be1-54ce31c41894 None None] [instance: 7c928a35-c5a7-45e1-9e9b-9ea987610ad5] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:04:33.329104 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-66fc97de-3f30-44b0-be58-db2550e22129 req-1c31e0c8-dcd6-4d32-8f87-7f68e8245506 service nova] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Received event network-vif-unplugged-72383914-4e53-4d9f-990b-d3cbcdd02186 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:04:33.329408 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-66fc97de-3f30-44b0-be58-db2550e22129 req-1c31e0c8-dcd6-4d32-8f87-7f68e8245506 service nova] Acquiring lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:33.329702 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-66fc97de-3f30-44b0-be58-db2550e22129 req-1c31e0c8-dcd6-4d32-8f87-7f68e8245506 service nova] Lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:33.330117 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-66fc97de-3f30-44b0-be58-db2550e22129 req-1c31e0c8-dcd6-4d32-8f87-7f68e8245506 service nova] Lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:33.330525 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-66fc97de-3f30-44b0-be58-db2550e22129 req-1c31e0c8-dcd6-4d32-8f87-7f68e8245506 service nova] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] No waiting events found dispatching network-vif-unplugged-72383914-4e53-4d9f-990b-d3cbcdd02186 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:04:33.330825 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-66fc97de-3f30-44b0-be58-db2550e22129 req-1c31e0c8-dcd6-4d32-8f87-7f68e8245506 service nova] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Received unexpected event network-vif-unplugged-72383914-4e53-4d9f-990b-d3cbcdd02186 for instance with vm_state active and task_state resize_migrating. Jan 26 19:04:33.380484 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Instance destroyed successfully. Jan 26 19:04:33.385886 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-674752828',display_name='tempest-ServerActionsTestJSON-server-674752828',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestjson-server-674752828',id=49,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaqJcAWtBvnDQt3Z0Zs2SEk8GmS4qswJn8I3pLNnZ26AiUp6izAb2VATu7Ta6RkUjooYd/ncwVnO6h5/K851Ht4DSyJ8eVOthZpoT3zQfgSsI2MjV6hMkI8XyrAdvV6PQ==',key_name='tempest-keypair-571396453',keypairs=,launch_index=0,launched_at=2026-01-27T00:00:30Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-fy6cug5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:04:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=d9448760-8b72-4805-9dd0-368ccddaaa12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72383914-4e53-4d9f-990b-d3cbcdd02186", "address": "fa:16:3e:06:2e:61", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1812167825-network", "vif_mac": "fa:16:3e:06:2e:61"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72383914-4e", "ovs_interfaceid": "72383914-4e53-4d9f-990b-d3cbcdd02186", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:04:33.385886 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "72383914-4e53-4d9f-990b-d3cbcdd02186", "address": "fa:16:3e:06:2e:61", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1812167825-network", "vif_mac": "fa:16:3e:06:2e:61"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72383914-4e", "ovs_interfaceid": "72383914-4e53-4d9f-990b-d3cbcdd02186", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:04:33.386170 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:2e:61,bridge_name='br-int',has_traffic_filtering=True,id=72383914-4e53-4d9f-990b-d3cbcdd02186,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72383914-4e') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:04:33.386170 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:2e:61,bridge_name='br-int',has_traffic_filtering=True,id=72383914-4e53-4d9f-990b-d3cbcdd02186,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72383914-4e') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:04:33.387659 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:33.388066 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72383914-4e, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:33.389206 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:33.392800 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:04:33.400240 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:33.401334 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:33.401654 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4cb740fd-1deb-48d5-b129-2f2666bfebb2) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:33.403138 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:33.405493 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:04:33.411517 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:33.413559 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:2e:61,bridge_name='br-int',has_traffic_filtering=True,id=72383914-4e53-4d9f-990b-d3cbcdd02186,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72383914-4e') Jan 26 19:04:33.418503 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:33.476805 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:04:33.476805 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:04:33.476805 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] No VIF found with MAC fa:16:3e:8d:68:9b, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:04:33.476805 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Using config drive Jan 26 19:04:33.491911 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12/disk --force-share --output=json" returned: 0 in 0.073s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:33.492638 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:33.563794 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12/disk --force-share --output=json" returned: 0 in 0.070s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:33.564732 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12_resize/disk /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12/disk {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:33.689936 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "cp -r /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12_resize/disk /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12/disk" returned: 0 in 0.125s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:33.690315 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12_resize/disk.config /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12/disk.config {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:33.706502 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3b8fa861-42f4-4354-bfd5-0775eaa2ef5f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968" "released" by "nova.compute.manager.ComputeManager.stop_instance..do_stop_instance" :: held 2.320s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:33.710883 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "cp -r /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12_resize/disk.config /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12/disk.config" returned: 0 in 0.020s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:33.711274 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12_resize/disk.info /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12/disk.info {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:33.727693 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "cp -r /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12_resize/disk.info /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12/disk.info" returned: 0 in 0.016s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:33.728482 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:33.728768 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:33.770220 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Port 72383914-4e53-4d9f-990b-d3cbcdd02186 binding to destination host np0005596550.novalocal is already ACTIVE {{(pid=189076) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jan 26 19:04:33.983543 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:34.134874 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Creating config drive at /opt/stack/data/nova/instances/2305cb8a-e8df-49d9-b208-018af3c736f0/disk.config Jan 26 19:04:34.139980 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/2305cb8a-e8df-49d9-b208-018af3c736f0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpjskztu5y {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:34.260076 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/2305cb8a-e8df-49d9-b208-018af3c736f0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpjskztu5y" returned: 0 in 0.120s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:34.348047 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:34.356998 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:34.365655 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:34.585432 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:04:34.585907 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] VM Started (Lifecycle Event) Jan 26 19:04:34.709884 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:34.718611 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:34.723469 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:34.727789 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:34.732803 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-416e7e46-e82e-412f-96ff-e45f7e78008a req-6709d570-1409-4b98-b10c-55ea9b3801be service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Received event network-vif-unplugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:04:34.732803 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-416e7e46-e82e-412f-96ff-e45f7e78008a req-6709d570-1409-4b98-b10c-55ea9b3801be service nova] Acquiring lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:34.732803 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-416e7e46-e82e-412f-96ff-e45f7e78008a req-6709d570-1409-4b98-b10c-55ea9b3801be service nova] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:34.732803 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-416e7e46-e82e-412f-96ff-e45f7e78008a req-6709d570-1409-4b98-b10c-55ea9b3801be service nova] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:34.732803 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-416e7e46-e82e-412f-96ff-e45f7e78008a req-6709d570-1409-4b98-b10c-55ea9b3801be service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] No waiting events found dispatching network-vif-unplugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:04:34.732803 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-416e7e46-e82e-412f-96ff-e45f7e78008a req-6709d570-1409-4b98-b10c-55ea9b3801be service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Received unexpected event network-vif-unplugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c for instance with vm_state stopped and task_state resize_prep. Jan 26 19:04:34.733901 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:34.803384 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:34.808316 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:34.809329 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.005s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:35.089349 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:04:35.098748 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:04:35.098947 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] VM Paused (Lifecycle Event) Jan 26 19:04:35.395775 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:35.405767 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-68665895-7176-49d4-9cfb-d93bc357554e req-818ba2f5-71af-44cc-9db4-c99715403933 service nova] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Received event network-vif-unplugged-72383914-4e53-4d9f-990b-d3cbcdd02186 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:04:35.405959 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-68665895-7176-49d4-9cfb-d93bc357554e req-818ba2f5-71af-44cc-9db4-c99715403933 service nova] Acquiring lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:35.406112 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-68665895-7176-49d4-9cfb-d93bc357554e req-818ba2f5-71af-44cc-9db4-c99715403933 service nova] Lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:35.406246 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-68665895-7176-49d4-9cfb-d93bc357554e req-818ba2f5-71af-44cc-9db4-c99715403933 service nova] Lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:35.410144 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-68665895-7176-49d4-9cfb-d93bc357554e req-818ba2f5-71af-44cc-9db4-c99715403933 service nova] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] No waiting events found dispatching network-vif-unplugged-72383914-4e53-4d9f-990b-d3cbcdd02186 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:04:35.410342 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-68665895-7176-49d4-9cfb-d93bc357554e req-818ba2f5-71af-44cc-9db4-c99715403933 service nova] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Received unexpected event network-vif-unplugged-72383914-4e53-4d9f-990b-d3cbcdd02186 for instance with vm_state active and task_state resize_migrated. Jan 26 19:04:35.410562 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-68665895-7176-49d4-9cfb-d93bc357554e req-818ba2f5-71af-44cc-9db4-c99715403933 service nova] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Received event network-vif-plugged-21ce5587-15cf-45c6-8f6e-7a9b1f201921 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:04:35.410753 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-68665895-7176-49d4-9cfb-d93bc357554e req-818ba2f5-71af-44cc-9db4-c99715403933 service nova] Acquiring lock "2305cb8a-e8df-49d9-b208-018af3c736f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:35.411002 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-68665895-7176-49d4-9cfb-d93bc357554e req-818ba2f5-71af-44cc-9db4-c99715403933 service nova] Lock "2305cb8a-e8df-49d9-b208-018af3c736f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:35.411190 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-68665895-7176-49d4-9cfb-d93bc357554e req-818ba2f5-71af-44cc-9db4-c99715403933 service nova] Lock "2305cb8a-e8df-49d9-b208-018af3c736f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:35.411378 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-68665895-7176-49d4-9cfb-d93bc357554e req-818ba2f5-71af-44cc-9db4-c99715403933 service nova] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Processing event network-vif-plugged-21ce5587-15cf-45c6-8f6e-7a9b1f201921 {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:04:35.411614 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-68665895-7176-49d4-9cfb-d93bc357554e req-818ba2f5-71af-44cc-9db4-c99715403933 service nova] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Received event network-vif-plugged-21ce5587-15cf-45c6-8f6e-7a9b1f201921 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:04:35.412515 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-68665895-7176-49d4-9cfb-d93bc357554e req-818ba2f5-71af-44cc-9db4-c99715403933 service nova] Acquiring lock "2305cb8a-e8df-49d9-b208-018af3c736f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:35.412733 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-68665895-7176-49d4-9cfb-d93bc357554e req-818ba2f5-71af-44cc-9db4-c99715403933 service nova] Lock "2305cb8a-e8df-49d9-b208-018af3c736f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:35.412962 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-68665895-7176-49d4-9cfb-d93bc357554e req-818ba2f5-71af-44cc-9db4-c99715403933 service nova] Lock "2305cb8a-e8df-49d9-b208-018af3c736f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:35.413118 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-68665895-7176-49d4-9cfb-d93bc357554e req-818ba2f5-71af-44cc-9db4-c99715403933 service nova] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] No waiting events found dispatching network-vif-plugged-21ce5587-15cf-45c6-8f6e-7a9b1f201921 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:04:35.413304 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-68665895-7176-49d4-9cfb-d93bc357554e req-818ba2f5-71af-44cc-9db4-c99715403933 service nova] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Received unexpected event network-vif-plugged-21ce5587-15cf-45c6-8f6e-7a9b1f201921 for instance with vm_state building and task_state spawning. Jan 26 19:04:35.414661 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:04:35.420682 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:04:35.426246 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Instance spawned successfully. Jan 26 19:04:35.426586 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:04:35.602799 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:04:35.607745 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:04:35.610381 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] VM Resumed (Lifecycle Event) Jan 26 19:04:35.726430 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Stashing vm_state: stopped {{(pid=189076) _prep_resize /opt/stack/nova/nova/compute/manager.py:6217}} Jan 26 19:04:35.817813 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:35.902678 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "refresh_cache-d9448760-8b72-4805-9dd0-368ccddaaa12" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:04:35.903218 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquired lock "refresh_cache-d9448760-8b72-4805-9dd0-368ccddaaa12" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:04:35.903408 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:04:35.938088 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:04:35.938908 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:04:35.938908 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:04:35.945901 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:04:35.945901 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:04:35.945901 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:04:36.112411 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:04:36.116029 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:04:36.332498 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:36.332596 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:36.405837 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:36.453972 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Took 7.01 seconds to spawn the instance on the hypervisor. Jan 26 19:04:36.453972 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:04:36.622050 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:04:36.790835 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:36.840897 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:04:36.841104 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Claim successful on node np0005596550.novalocal Jan 26 19:04:36.969155 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Took 12.59 seconds to build instance. Jan 26 19:04:37.011189 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:37.127060 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Updating instance_info_cache with network_info: [{"id": "72383914-4e53-4d9f-990b-d3cbcdd02186", "address": "fa:16:3e:06:2e:61", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72383914-4e", "ovs_interfaceid": "72383914-4e53-4d9f-990b-d3cbcdd02186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:04:37.350183 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.resource_tracker [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Updating resource usage from migration 1a98122f-c500-4aa5-b3c1-d3ef0a7b5f2b Jan 26 19:04:37.481682 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-553d2105-d500-45da-8d43-2ca791bebb71 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Lock "2305cb8a-e8df-49d9-b208-018af3c736f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.111s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:37.635805 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Releasing lock "refresh_cache-d9448760-8b72-4805-9dd0-368ccddaaa12" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:04:37.665899 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:04:38.178823 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:04:38.252203 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Starting finish_migration {{(pid=189076) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12668}} Jan 26 19:04:38.252203 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Instance directory exists: not creating {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5157}} Jan 26 19:04:38.252203 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Creating image(s) Jan 26 19:04:38.253601 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:38.351820 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.096s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:38.351820 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:04:38.351820 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:38.405799 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:38.508956 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:38.511502 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Cannot resize image /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:04:38.692996 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.358s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:38.692996 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Migrating Jan 26 19:04:39.021298 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Did not create local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5295}} Jan 26 19:04:39.021298 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Ensure instance console log exists: /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:04:39.021298 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:39.021298 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:39.021298 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:39.022639 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Start _get_guest_xml network_info=[{"id": "72383914-4e53-4d9f-990b-d3cbcdd02186", "address": "fa:16:3e:06:2e:61", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1812167825-network", "vif_mac": "fa:16:3e:06:2e:61"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72383914-4e", "ovs_interfaceid": "72383914-4e53-4d9f-990b-d3cbcdd02186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:04:39.028916 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:04:39.030656 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestJSON-server-674752828', uuid='d9448760-8b72-4805-9dd0-368ccddaaa12'), owner=OwnerMeta(userid='25c3c9ca754941ccbd986028c2a87e07', username='tempest-ServerActionsTestJSON-960489083-project-member', projectid='2efcb8570b994820a5956fab4e859054', projectname='tempest-ServerActionsTestJSON-960489083'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "72383914-4e53-4d9f-990b-d3cbcdd02186", "address": "fa:16:3e:06:2e:61", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1812167825-network", "vif_mac": "fa:16:3e:06:2e:61"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72383914-4e", "ovs_interfaceid": "72383914-4e53-4d9f-990b-d3cbcdd02186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472279.030231) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:04:39.032666 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:04:39.033184 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:04:39.036529 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:04:39.037411 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:04:39.038848 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:04:39.039273 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:04:39.039649 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:04:39.039860 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:04:39.040110 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:04:39.040284 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:04:39.040463 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:04:39.040695 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:04:39.040939 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:04:39.041260 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:04:39.041533 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:04:39.041744 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:04:39.053906 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-674752828',display_name='tempest-ServerActionsTestJSON-server-674752828',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestjson-server-674752828',id=49,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaqJcAWtBvnDQt3Z0Zs2SEk8GmS4qswJn8I3pLNnZ26AiUp6izAb2VATu7Ta6RkUjooYd/ncwVnO6h5/K851Ht4DSyJ8eVOthZpoT3zQfgSsI2MjV6hMkI8XyrAdvV6PQ==',key_name='tempest-keypair-571396453',keypairs=,launch_index=0,launched_at=2026-01-27T00:00:30Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-fy6cug5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:04:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=d9448760-8b72-4805-9dd0-368ccddaaa12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72383914-4e53-4d9f-990b-d3cbcdd02186", "address": "fa:16:3e:06:2e:61", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1812167825-network", "vif_mac": "fa:16:3e:06:2e:61"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72383914-4e", "ovs_interfaceid": "72383914-4e53-4d9f-990b-d3cbcdd02186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:04:39.053906 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "72383914-4e53-4d9f-990b-d3cbcdd02186", "address": "fa:16:3e:06:2e:61", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1812167825-network", "vif_mac": "fa:16:3e:06:2e:61"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72383914-4e", "ovs_interfaceid": "72383914-4e53-4d9f-990b-d3cbcdd02186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:04:39.054298 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:2e:61,bridge_name='br-int',has_traffic_filtering=True,id=72383914-4e53-4d9f-990b-d3cbcdd02186,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72383914-4e') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] End _get_guest_xml xml= Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: d9448760-8b72-4805-9dd0-368ccddaaa12 Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: instance-00000031 Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: 262144 Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestJSON-server-674752828 Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:04:39 Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: 256 Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: ide Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: pc Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestJSON-960489083-project-member Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestJSON-960489083 Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: d9448760-8b72-4805-9dd0-368ccddaaa12 Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: d9448760-8b72-4805-9dd0-368ccddaaa12 Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:39.055790 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:04:39.058554 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-674752828',display_name='tempest-ServerActionsTestJSON-server-674752828',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestjson-server-674752828',id=49,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaqJcAWtBvnDQt3Z0Zs2SEk8GmS4qswJn8I3pLNnZ26AiUp6izAb2VATu7Ta6RkUjooYd/ncwVnO6h5/K851Ht4DSyJ8eVOthZpoT3zQfgSsI2MjV6hMkI8XyrAdvV6PQ==',key_name='tempest-keypair-571396453',keypairs=,launch_index=0,launched_at=2026-01-27T00:00:30Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-fy6cug5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:04:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=d9448760-8b72-4805-9dd0-368ccddaaa12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72383914-4e53-4d9f-990b-d3cbcdd02186", "address": "fa:16:3e:06:2e:61", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1812167825-network", "vif_mac": "fa:16:3e:06:2e:61"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72383914-4e", "ovs_interfaceid": "72383914-4e53-4d9f-990b-d3cbcdd02186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:04:39.058926 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "72383914-4e53-4d9f-990b-d3cbcdd02186", "address": "fa:16:3e:06:2e:61", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1812167825-network", "vif_mac": "fa:16:3e:06:2e:61"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72383914-4e", "ovs_interfaceid": "72383914-4e53-4d9f-990b-d3cbcdd02186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:04:39.060034 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:2e:61,bridge_name='br-int',has_traffic_filtering=True,id=72383914-4e53-4d9f-990b-d3cbcdd02186,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72383914-4e') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:04:39.060595 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:2e:61,bridge_name='br-int',has_traffic_filtering=True,id=72383914-4e53-4d9f-990b-d3cbcdd02186,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72383914-4e') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:04:39.061329 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Acquiring lock "2305cb8a-e8df-49d9-b208-018af3c736f0" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:39.061592 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Lock "2305cb8a-e8df-49d9-b208-018af3c736f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:39.061866 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Acquiring lock "2305cb8a-e8df-49d9-b208-018af3c736f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:39.062069 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Lock "2305cb8a-e8df-49d9-b208-018af3c736f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:39.062259 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Lock "2305cb8a-e8df-49d9-b208-018af3c736f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:39.063831 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:39.064190 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:39.064537 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:04:39.065651 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Terminating instance Jan 26 19:04:39.066903 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:39.068094 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95c5f841-01ac-5ad6-8ef6-7d7b235fa16b', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:39.069017 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:39.071164 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:04:39.078799 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:39.085858 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:39.085858 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72383914-4e, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:39.085858 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72383914-4e, col_values=(('qos', UUID('e0c486a7-bd89-4269-b0cf-75ebffa86535')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:39.085858 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72383914-4e, col_values=(('external_ids', {'iface-id': '72383914-4e53-4d9f-990b-d3cbcdd02186', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:2e:61', 'vm-uuid': 'd9448760-8b72-4805-9dd0-368ccddaaa12'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:39.086316 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:39.093217 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:04:39.103140 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:39.105766 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:2e:61,bridge_name='br-int',has_traffic_filtering=True,id=72383914-4e53-4d9f-990b-d3cbcdd02186,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72383914-4e') Jan 26 19:04:39.213937 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "refresh_cache-ca9a34ab-50c7-4278-b247-c7a7baeb5968" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:04:39.213937 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquired lock "refresh_cache-ca9a34ab-50c7-4278-b247-c7a7baeb5968" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:04:39.213937 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:04:39.569584 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:04:39.654069 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:39.679690 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:39.701461 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:39.702252 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:39.719918 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:39.814057 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f893575c-b4fe-4f01-ad25-cdc8746a7449 req-7306e035-965a-4fbf-a64c-5e40f26293d7 service nova] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Received event network-vif-unplugged-21ce5587-15cf-45c6-8f6e-7a9b1f201921 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:04:39.814235 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f893575c-b4fe-4f01-ad25-cdc8746a7449 req-7306e035-965a-4fbf-a64c-5e40f26293d7 service nova] Acquiring lock "2305cb8a-e8df-49d9-b208-018af3c736f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:39.814404 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f893575c-b4fe-4f01-ad25-cdc8746a7449 req-7306e035-965a-4fbf-a64c-5e40f26293d7 service nova] Lock "2305cb8a-e8df-49d9-b208-018af3c736f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:39.814514 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f893575c-b4fe-4f01-ad25-cdc8746a7449 req-7306e035-965a-4fbf-a64c-5e40f26293d7 service nova] Lock "2305cb8a-e8df-49d9-b208-018af3c736f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:39.814645 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f893575c-b4fe-4f01-ad25-cdc8746a7449 req-7306e035-965a-4fbf-a64c-5e40f26293d7 service nova] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] No waiting events found dispatching network-vif-unplugged-21ce5587-15cf-45c6-8f6e-7a9b1f201921 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:04:39.814812 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f893575c-b4fe-4f01-ad25-cdc8746a7449 req-7306e035-965a-4fbf-a64c-5e40f26293d7 service nova] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Received event network-vif-unplugged-21ce5587-15cf-45c6-8f6e-7a9b1f201921 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:04:39.897822 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Instance destroyed successfully. Jan 26 19:04:39.898207 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Lazy-loading 'resources' on Instance uuid 2305cb8a-e8df-49d9-b208-018af3c736f0 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:04:40.081198 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:40.201810 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Updating instance_info_cache with network_info: [{"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:04:40.404688 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:04:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerGroupTestJSON-server-652324328',display_name='tempest-ServerGroupTestJSON-server-652324328',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-servergrouptestjson-server-652324328',id=65,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:04:36Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='f1f25df9dbf944a6885f4c9d7a4f66e7',ramdisk_id='',reservation_id='r-d6rtu5dh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerGroupTestJSON-824286846',owner_user_name='tempest-ServerGroupTestJSON-824286846-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:04:36Z,user_data=None,user_id='21be6ea60d71454ba2ed6d100e93abf0',uuid=2305cb8a-e8df-49d9-b208-018af3c736f0,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21ce5587-15cf-45c6-8f6e-7a9b1f201921", "address": "fa:16:3e:8d:68:9b", "network": {"id": "1c717314-7249-403f-8b3e-1705a2a1d27d", "bridge": "br-int", "label": "tempest-ServerGroupTestJSON-2115004707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f1f25df9dbf944a6885f4c9d7a4f66e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce5587-15", "ovs_interfaceid": "21ce5587-15cf-45c6-8f6e-7a9b1f201921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:04:40.405356 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Converting VIF {"id": "21ce5587-15cf-45c6-8f6e-7a9b1f201921", "address": "fa:16:3e:8d:68:9b", "network": {"id": "1c717314-7249-403f-8b3e-1705a2a1d27d", "bridge": "br-int", "label": "tempest-ServerGroupTestJSON-2115004707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f1f25df9dbf944a6885f4c9d7a4f66e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce5587-15", "ovs_interfaceid": "21ce5587-15cf-45c6-8f6e-7a9b1f201921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:04:40.406287 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:68:9b,bridge_name='br-int',has_traffic_filtering=True,id=21ce5587-15cf-45c6-8f6e-7a9b1f201921,network=Network(1c717314-7249-403f-8b3e-1705a2a1d27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ce5587-15') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:04:40.406749 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:68:9b,bridge_name='br-int',has_traffic_filtering=True,id=21ce5587-15cf-45c6-8f6e-7a9b1f201921,network=Network(1c717314-7249-403f-8b3e-1705a2a1d27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ce5587-15') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:04:40.408731 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:40.409272 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21ce5587-15, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:40.412177 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:40.415245 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:04:40.425513 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:40.426840 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:40.427207 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=961afc10-c8e3-4eac-935e-256a3d8698c8) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:40.428155 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:40.430331 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:04:40.443313 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:40.446761 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:68:9b,bridge_name='br-int',has_traffic_filtering=True,id=21ce5587-15cf-45c6-8f6e-7a9b1f201921,network=Network(1c717314-7249-403f-8b3e-1705a2a1d27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ce5587-15') Jan 26 19:04:40.447397 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Deleting instance files /opt/stack/data/nova/instances/2305cb8a-e8df-49d9-b208-018af3c736f0_del Jan 26 19:04:40.448300 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Deletion of /opt/stack/data/nova/instances/2305cb8a-e8df-49d9-b208-018af3c736f0_del complete Jan 26 19:04:40.643106 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:04:40.643306 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:04:40.643346 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] No VIF found with MAC fa:16:3e:06:2e:61, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:04:40.643868 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Using config drive Jan 26 19:04:40.707814 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Releasing lock "refresh_cache-ca9a34ab-50c7-4278-b247-c7a7baeb5968" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:04:40.709061 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:40.721712 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:40.914273 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for d9448760-8b72-4805-9dd0-368ccddaaa12 due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:04:40.914368 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:04:40.914553 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] VM Resumed (Lifecycle Event) Jan 26 19:04:40.917086 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Instance event wait completed in 0 seconds for {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:04:40.921562 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Instance running successfully. Jan 26 19:04:40.924948 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Failed to set time: agent not configured {{(pid=189076) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}} Jan 26 19:04:40.925136 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-118bad12-68db-471b-a43c-d504152c7cc3 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] finish_migration finished successfully. {{(pid=189076) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12763}} Jan 26 19:04:40.956952 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Took 1.39 seconds to destroy the instance on the hypervisor. Jan 26 19:04:40.957246 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:04:40.957549 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:04:40.957704 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:04:40.958274 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:41.021589 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:41.032569 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:41.042136 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:41.045835 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:41.097450 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:41.420161 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:04:41.424407 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:04:41.871202 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7f6530ec-6358-46be-9856-e5037d730137 req-6a7ea31e-97df-4510-afb1-21cbf5cbccc3 service nova] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Received event network-vif-unplugged-21ce5587-15cf-45c6-8f6e-7a9b1f201921 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:04:41.872191 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7f6530ec-6358-46be-9856-e5037d730137 req-6a7ea31e-97df-4510-afb1-21cbf5cbccc3 service nova] Acquiring lock "2305cb8a-e8df-49d9-b208-018af3c736f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:41.872191 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7f6530ec-6358-46be-9856-e5037d730137 req-6a7ea31e-97df-4510-afb1-21cbf5cbccc3 service nova] Lock "2305cb8a-e8df-49d9-b208-018af3c736f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:41.872191 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7f6530ec-6358-46be-9856-e5037d730137 req-6a7ea31e-97df-4510-afb1-21cbf5cbccc3 service nova] Lock "2305cb8a-e8df-49d9-b208-018af3c736f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:41.872483 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7f6530ec-6358-46be-9856-e5037d730137 req-6a7ea31e-97df-4510-afb1-21cbf5cbccc3 service nova] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] No waiting events found dispatching network-vif-unplugged-21ce5587-15cf-45c6-8f6e-7a9b1f201921 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:04:41.874902 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7f6530ec-6358-46be-9856-e5037d730137 req-6a7ea31e-97df-4510-afb1-21cbf5cbccc3 service nova] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Received event network-vif-unplugged-21ce5587-15cf-45c6-8f6e-7a9b1f201921 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:04:41.874902 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7f6530ec-6358-46be-9856-e5037d730137 req-6a7ea31e-97df-4510-afb1-21cbf5cbccc3 service nova] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Received event network-vif-plugged-72383914-4e53-4d9f-990b-d3cbcdd02186 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:04:41.874902 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7f6530ec-6358-46be-9856-e5037d730137 req-6a7ea31e-97df-4510-afb1-21cbf5cbccc3 service nova] Acquiring lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:41.874902 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7f6530ec-6358-46be-9856-e5037d730137 req-6a7ea31e-97df-4510-afb1-21cbf5cbccc3 service nova] Lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:41.874902 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7f6530ec-6358-46be-9856-e5037d730137 req-6a7ea31e-97df-4510-afb1-21cbf5cbccc3 service nova] Lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:41.874902 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7f6530ec-6358-46be-9856-e5037d730137 req-6a7ea31e-97df-4510-afb1-21cbf5cbccc3 service nova] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] No waiting events found dispatching network-vif-plugged-72383914-4e53-4d9f-990b-d3cbcdd02186 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:04:41.874902 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-7f6530ec-6358-46be-9856-e5037d730137 req-6a7ea31e-97df-4510-afb1-21cbf5cbccc3 service nova] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Received unexpected event network-vif-plugged-72383914-4e53-4d9f-990b-d3cbcdd02186 for instance with vm_state active and task_state resize_finish. Jan 26 19:04:41.874902 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7f6530ec-6358-46be-9856-e5037d730137 req-6a7ea31e-97df-4510-afb1-21cbf5cbccc3 service nova] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Received event network-vif-plugged-72383914-4e53-4d9f-990b-d3cbcdd02186 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:04:41.875533 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7f6530ec-6358-46be-9856-e5037d730137 req-6a7ea31e-97df-4510-afb1-21cbf5cbccc3 service nova] Acquiring lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:41.875533 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7f6530ec-6358-46be-9856-e5037d730137 req-6a7ea31e-97df-4510-afb1-21cbf5cbccc3 service nova] Lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:41.875669 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7f6530ec-6358-46be-9856-e5037d730137 req-6a7ea31e-97df-4510-afb1-21cbf5cbccc3 service nova] Lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:41.875939 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7f6530ec-6358-46be-9856-e5037d730137 req-6a7ea31e-97df-4510-afb1-21cbf5cbccc3 service nova] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] No waiting events found dispatching network-vif-plugged-72383914-4e53-4d9f-990b-d3cbcdd02186 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:04:41.876226 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-7f6530ec-6358-46be-9856-e5037d730137 req-6a7ea31e-97df-4510-afb1-21cbf5cbccc3 service nova] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Received unexpected event network-vif-plugged-72383914-4e53-4d9f-990b-d3cbcdd02186 for instance with vm_state active and task_state resize_finish. Jan 26 19:04:41.935306 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] During sync_power_state the instance has a pending task (resize_finish). Skip. Jan 26 19:04:41.935673 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:04:41.935998 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] VM Started (Lifecycle Event) Jan 26 19:04:41.981957 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:42.236450 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Starting migrate_disk_and_power_off {{(pid=189076) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12481}} Jan 26 19:04:42.249260 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Instance destroyed successfully. Jan 26 19:04:42.250224 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-612125545',display_name='tempest-ServerActionsTestOtherB-server-612125545',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-612125545',id=63,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK72/fZgFXc8Nm23qFp5bqxu5uQWjdqvi6tf0S8eHH5LAOejrjAG2pg3k7mvst6GtMR5cAEv++XPpoBWMRpc6kXyw3lb+Uukjxykolyr/SPF2WcEU8zRsEYayUYxi/WyQ==',key_name='tempest-keypair-56259378',keypairs=,launch_index=0,launched_at=2026-01-27T00:02:58Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-ffq07oni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='stopped',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:04:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=ca9a34ab-50c7-4278-b247-c7a7baeb5968,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-630226605-network", "vif_mac": "fa:16:3e:5b:ff:6f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:04:42.250641 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-630226605-network", "vif_mac": "fa:16:3e:5b:ff:6f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:04:42.251283 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ff:6f,bridge_name='br-int',has_traffic_filtering=True,id=7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eafe7fe-12') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:04:42.251599 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ff:6f,bridge_name='br-int',has_traffic_filtering=True,id=7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eafe7fe-12') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:04:42.253068 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:42.253148 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7eafe7fe-12, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:42.256836 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:42.258948 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:42.260187 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:42.260347 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e4950d3-ae08-4293-9055-0a5131f4a8bd) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:42.262193 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:42.266115 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:42.271226 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ff:6f,bridge_name='br-int',has_traffic_filtering=True,id=7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eafe7fe-12') Jan 26 19:04:42.280813 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:42.391098 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:42.391606 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:42.447569 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:04:42.457390 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json" returned: 0 in 0.066s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:42.459588 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968_resize/disk /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:42.474071 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:04:42.487290 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "cp -r /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968_resize/disk /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk" returned: 0 in 0.027s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:42.487290 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968_resize/disk.config /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk.config {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:42.513929 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "cp -r /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968_resize/disk.config /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk.config" returned: 0 in 0.027s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:42.514362 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968_resize/disk.info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk.info {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:42.545230 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "cp -r /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968_resize/disk.info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk.info" returned: 0 in 0.030s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:42.546099 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:42.546675 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:42.617042 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Port 7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c binding to destination host np0005596550.novalocal is already ACTIVE {{(pid=189076) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jan 26 19:04:42.767955 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:04:43.247980 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2afb902f-c7ad-409c-8ffa-08a0f3e85ee7 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "d9448760-8b72-4805-9dd0-368ccddaaa12" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:43.248509 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2afb902f-c7ad-409c-8ffa-08a0f3e85ee7 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "d9448760-8b72-4805-9dd0-368ccddaaa12" acquired by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:43.248509 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-2afb902f-c7ad-409c-8ffa-08a0f3e85ee7 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Going to confirm migration 5 {{(pid=189076) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5331}} Jan 26 19:04:43.272728 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Took 2.31 seconds to deallocate network for instance. Jan 26 19:04:43.650960 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:43.651097 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:43.651328 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:43.753871 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-2afb902f-c7ad-409c-8ffa-08a0f3e85ee7 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:43.783201 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:43.783474 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:43.812994 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-2afb902f-c7ad-409c-8ffa-08a0f3e85ee7 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:43.813900 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2afb902f-c7ad-409c-8ffa-08a0f3e85ee7 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "refresh_cache-d9448760-8b72-4805-9dd0-368ccddaaa12" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:04:43.813900 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2afb902f-c7ad-409c-8ffa-08a0f3e85ee7 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquired lock "refresh_cache-d9448760-8b72-4805-9dd0-368ccddaaa12" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:04:43.813900 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-2afb902f-c7ad-409c-8ffa-08a0f3e85ee7 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:04:43.813968 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-2afb902f-c7ad-409c-8ffa-08a0f3e85ee7 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'info_cache' on Instance uuid d9448760-8b72-4805-9dd0-368ccddaaa12 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:04:43.914157 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4a6691d9-b626-407e-b98f-ce4f3cea3e37 req-f57428c2-d10c-43e0-84eb-d6abb1f905c2 service nova] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Received event network-vif-deleted-21ce5587-15cf-45c6-8f6e-7a9b1f201921 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:04:44.025310 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:04:44.528958 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:04:44.690011 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:44.751756 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "refresh_cache-ca9a34ab-50c7-4278-b247-c7a7baeb5968" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:04:44.752125 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquired lock "refresh_cache-ca9a34ab-50c7-4278-b247-c7a7baeb5968" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:04:44.752537 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:04:44.820100 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-2afb902f-c7ad-409c-8ffa-08a0f3e85ee7 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:45.042110 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.258s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:45.071443 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-2afb902f-c7ad-409c-8ffa-08a0f3e85ee7 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:45.084457 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Deleted allocations for instance 2305cb8a-e8df-49d9-b208-018af3c736f0 Jan 26 19:04:45.146549 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-2afb902f-c7ad-409c-8ffa-08a0f3e85ee7 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Updating instance_info_cache with network_info: [{"id": "72383914-4e53-4d9f-990b-d3cbcdd02186", "address": "fa:16:3e:06:2e:61", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72383914-4e", "ovs_interfaceid": "72383914-4e53-4d9f-990b-d3cbcdd02186", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:04:45.256124 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:45.535762 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:45.622970 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Updating instance_info_cache with network_info: [{"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:04:45.648570 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2afb902f-c7ad-409c-8ffa-08a0f3e85ee7 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Releasing lock "refresh_cache-d9448760-8b72-4805-9dd0-368ccddaaa12" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:04:45.648737 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-2afb902f-c7ad-409c-8ffa-08a0f3e85ee7 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'migration_context' on Instance uuid d9448760-8b72-4805-9dd0-368ccddaaa12 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:04:46.100508 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0bd2ec6e-5187-47ee-b1a8-d583a0b20592 tempest-ServerGroupTestJSON-824286846 tempest-ServerGroupTestJSON-824286846-project-member] Lock "2305cb8a-e8df-49d9-b208-018af3c736f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.039s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:46.130794 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Releasing lock "refresh_cache-ca9a34ab-50c7-4278-b247-c7a7baeb5968" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:04:46.156809 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-2afb902f-c7ad-409c-8ffa-08a0f3e85ee7 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Object Instance lazy-loaded attributes: info_cache,migration_context {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:04:46.156809 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2afb902f-c7ad-409c-8ffa-08a0f3e85ee7 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:46.156809 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2afb902f-c7ad-409c-8ffa-08a0f3e85ee7 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:46.676128 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Starting finish_migration {{(pid=189076) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12668}} Jan 26 19:04:46.677075 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Instance directory exists: not creating {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5157}} Jan 26 19:04:46.677238 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Creating image(s) Jan 26 19:04:46.678589 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:46.760560 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.082s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:46.760838 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:04:46.761143 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:46.848846 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:46.849120 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Cannot resize image /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:04:46.873560 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-2afb902f-c7ad-409c-8ffa-08a0f3e85ee7 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:04:46.984526 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:47.263763 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:47.352250 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Did not create local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5295}} Jan 26 19:04:47.352442 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Ensure instance console log exists: /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:04:47.352804 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:47.352993 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:47.353188 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:47.359116 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Start _get_guest_xml network_info=[{"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-630226605-network", "vif_mac": "fa:16:3e:5b:ff:6f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:04:47.365441 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:04:47.367143 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-612125545', uuid='ca9a34ab-50c7-4278-b247-c7a7baeb5968'), owner=OwnerMeta(userid='8369268788c24337ade1739d948c300a', username='tempest-ServerActionsTestOtherB-1262198412-project-member', projectid='8428b9d1e48c42f690612bf1e012ec42', projectname='tempest-ServerActionsTestOtherB-1262198412'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-630226605-network", "vif_mac": "fa:16:3e:5b:ff:6f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472287.366663) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:04:47.368527 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:04:47.368950 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:04:47.370651 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:04:47.371239 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:04:47.372353 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:04:47.372710 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:04:47.372935 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:04:47.373124 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:04:47.373312 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:04:47.373470 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:04:47.373667 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:04:47.373953 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:04:47.374133 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:04:47.374353 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:04:47.374535 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:04:47.374712 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:04:47.378054 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk.config --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:47.389789 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-2afb902f-c7ad-409c-8ffa-08a0f3e85ee7 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:04:47.482996 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk.config --force-share --output=json" returned: 0 in 0.105s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:47.483402 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:47.483661 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "/opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:47.484418 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "/opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:47.485735 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-612125545',display_name='tempest-ServerActionsTestOtherB-server-612125545',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-612125545',id=63,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK72/fZgFXc8Nm23qFp5bqxu5uQWjdqvi6tf0S8eHH5LAOejrjAG2pg3k7mvst6GtMR5cAEv++XPpoBWMRpc6kXyw3lb+Uukjxykolyr/SPF2WcEU8zRsEYayUYxi/WyQ==',key_name='tempest-keypair-56259378',keypairs=,launch_index=0,launched_at=2026-01-27T00:02:58Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-ffq07oni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='stopped',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:04:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=ca9a34ab-50c7-4278-b247-c7a7baeb5968,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-630226605-network", "vif_mac": "fa:16:3e:5b:ff:6f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:04:47.486083 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-630226605-network", "vif_mac": "fa:16:3e:5b:ff:6f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:04:47.486974 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ff:6f,bridge_name='br-int',has_traffic_filtering=True,id=7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eafe7fe-12') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] End _get_guest_xml xml= Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: ca9a34ab-50c7-4278-b247-c7a7baeb5968 Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: instance-0000003f Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: 262144 Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-server-612125545 Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:04:47 Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: 256 Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: ide Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: pc Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-1262198412-project-member Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-1262198412 Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: ca9a34ab-50c7-4278-b247-c7a7baeb5968 Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: ca9a34ab-50c7-4278-b247-c7a7baeb5968 Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:47.488868 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:04:47.490097 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-612125545',display_name='tempest-ServerActionsTestOtherB-server-612125545',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-612125545',id=63,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK72/fZgFXc8Nm23qFp5bqxu5uQWjdqvi6tf0S8eHH5LAOejrjAG2pg3k7mvst6GtMR5cAEv++XPpoBWMRpc6kXyw3lb+Uukjxykolyr/SPF2WcEU8zRsEYayUYxi/WyQ==',key_name='tempest-keypair-56259378',keypairs=,launch_index=0,launched_at=2026-01-27T00:02:58Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-ffq07oni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='stopped',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:04:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=ca9a34ab-50c7-4278-b247-c7a7baeb5968,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-630226605-network", "vif_mac": "fa:16:3e:5b:ff:6f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:04:47.490097 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-630226605-network", "vif_mac": "fa:16:3e:5b:ff:6f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:04:47.490218 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ff:6f,bridge_name='br-int',has_traffic_filtering=True,id=7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eafe7fe-12') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:04:47.490351 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ff:6f,bridge_name='br-int',has_traffic_filtering=True,id=7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eafe7fe-12') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:04:47.490874 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:47.491225 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:47.491532 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:04:47.492304 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:47.492504 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fddbf34b-094e-5557-b6df-1177a6ec5498', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:47.493622 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:47.496245 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:47.498947 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:47.499130 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7eafe7fe-12, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:47.499465 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7eafe7fe-12, col_values=(('qos', UUID('6c2a099a-b4db-471c-82a5-c17c20b52ba7')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:47.499647 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7eafe7fe-12, col_values=(('external_ids', {'iface-id': '7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:ff:6f', 'vm-uuid': 'ca9a34ab-50c7-4278-b247-c7a7baeb5968'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:47.502007 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:47.507628 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:04:47.510448 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:47.511516 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ff:6f,bridge_name='br-int',has_traffic_filtering=True,id=7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eafe7fe-12') Jan 26 19:04:47.680637 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:04:47.680637 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] VM Stopped (Lifecycle Event) Jan 26 19:04:47.894758 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:48.189171 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a4c00305-2230-41eb-b833-6ac6cc2393ca None None] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:04:48.198993 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a4c00305-2230-41eb-b833-6ac6cc2393ca None None] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: resize_finish, current DB power_state: 4, VM power_state: 4 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:04:48.404200 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2afb902f-c7ad-409c-8ffa-08a0f3e85ee7 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.248s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:48.710869 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-a4c00305-2230-41eb-b833-6ac6cc2393ca None None] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] During sync_power_state the instance has a pending task (resize_finish). Skip. Jan 26 19:04:49.018632 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-2afb902f-c7ad-409c-8ffa-08a0f3e85ee7 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Deleted allocation for migration ba0fda27-2dcc-44f5-b424-1e322a8c9780 Jan 26 19:04:49.050630 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:04:49.050781 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:04:49.050971 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No VIF found with MAC fa:16:3e:5b:ff:6f, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:04:49.051890 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Using config drive Jan 26 19:04:49.052304 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Instance event wait completed in 0 seconds for {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:04:49.052496 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6d28efce-21f6-4e6f-a2f8-eace4da68f69 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] finish_migration finished successfully. {{(pid=189076) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12763}} Jan 26 19:04:49.524393 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2afb902f-c7ad-409c-8ffa-08a0f3e85ee7 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "d9448760-8b72-4805-9dd0-368ccddaaa12" "released" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: held 6.276s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:49.811309 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-babb4e39-10e5-46c5-acab-d55c48f4dd36 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "d9448760-8b72-4805-9dd0-368ccddaaa12" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:49.811686 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-babb4e39-10e5-46c5-acab-d55c48f4dd36 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "d9448760-8b72-4805-9dd0-368ccddaaa12" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:49.813146 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-babb4e39-10e5-46c5-acab-d55c48f4dd36 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:49.813427 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-babb4e39-10e5-46c5-acab-d55c48f4dd36 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:49.813630 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-babb4e39-10e5-46c5-acab-d55c48f4dd36 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:49.820959 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-babb4e39-10e5-46c5-acab-d55c48f4dd36 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Terminating instance Jan 26 19:04:50.327221 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-babb4e39-10e5-46c5-acab-d55c48f4dd36 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:04:50.364157 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:50.368687 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:50.390133 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-48942c34-23bb-40e8-a838-1cef319e6f57 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:50.390133 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-48942c34-23bb-40e8-a838-1cef319e6f57 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968" acquired by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:50.390133 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-48942c34-23bb-40e8-a838-1cef319e6f57 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Going to confirm migration 6 {{(pid=189076) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5331}} Jan 26 19:04:50.397171 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:50.419373 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:50.575596 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c3d13b09-8c0c-41a3-bdff-d2da10d67f01 req-32da1a8b-3a16-4842-9a22-40a9b27bdaaf service nova] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Received event network-vif-unplugged-72383914-4e53-4d9f-990b-d3cbcdd02186 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:04:50.575943 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c3d13b09-8c0c-41a3-bdff-d2da10d67f01 req-32da1a8b-3a16-4842-9a22-40a9b27bdaaf service nova] Acquiring lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:50.576274 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c3d13b09-8c0c-41a3-bdff-d2da10d67f01 req-32da1a8b-3a16-4842-9a22-40a9b27bdaaf service nova] Lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:50.577419 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c3d13b09-8c0c-41a3-bdff-d2da10d67f01 req-32da1a8b-3a16-4842-9a22-40a9b27bdaaf service nova] Lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:50.577690 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c3d13b09-8c0c-41a3-bdff-d2da10d67f01 req-32da1a8b-3a16-4842-9a22-40a9b27bdaaf service nova] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] No waiting events found dispatching network-vif-unplugged-72383914-4e53-4d9f-990b-d3cbcdd02186 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:04:50.578217 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c3d13b09-8c0c-41a3-bdff-d2da10d67f01 req-32da1a8b-3a16-4842-9a22-40a9b27bdaaf service nova] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Received event network-vif-unplugged-72383914-4e53-4d9f-990b-d3cbcdd02186 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:04:50.586886 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Acquiring lock "f08a5384-6c6a-4ba6-b624-21dd5468299b" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:50.589863 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "f08a5384-6c6a-4ba6-b624-21dd5468299b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:50.612289 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Instance destroyed successfully. Jan 26 19:04:50.612723 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-babb4e39-10e5-46c5-acab-d55c48f4dd36 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'resources' on Instance uuid d9448760-8b72-4805-9dd0-368ccddaaa12 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:04:50.897082 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-48942c34-23bb-40e8-a838-1cef319e6f57 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:50.969039 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-48942c34-23bb-40e8-a838-1cef319e6f57 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:50.969039 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-48942c34-23bb-40e8-a838-1cef319e6f57 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "refresh_cache-ca9a34ab-50c7-4278-b247-c7a7baeb5968" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:04:50.969039 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-48942c34-23bb-40e8-a838-1cef319e6f57 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquired lock "refresh_cache-ca9a34ab-50c7-4278-b247-c7a7baeb5968" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:04:50.969039 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-48942c34-23bb-40e8-a838-1cef319e6f57 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:04:50.969039 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-48942c34-23bb-40e8-a838-1cef319e6f57 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'info_cache' on Instance uuid ca9a34ab-50c7-4278-b247-c7a7baeb5968 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:04:51.098760 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:04:51.115411 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-babb4e39-10e5-46c5-acab-d55c48f4dd36 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-674752828',display_name='tempest-ServerActionsTestJSON-server-674752828',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestjson-server-674752828',id=49,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaqJcAWtBvnDQt3Z0Zs2SEk8GmS4qswJn8I3pLNnZ26AiUp6izAb2VATu7Ta6RkUjooYd/ncwVnO6h5/K851Ht4DSyJ8eVOthZpoT3zQfgSsI2MjV6hMkI8XyrAdvV6PQ==',key_name='tempest-keypair-571396453',keypairs=,launch_index=0,launched_at=2026-01-27T00:04:41Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-fy6cug5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:04:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=d9448760-8b72-4805-9dd0-368ccddaaa12,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72383914-4e53-4d9f-990b-d3cbcdd02186", "address": "fa:16:3e:06:2e:61", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72383914-4e", "ovs_interfaceid": "72383914-4e53-4d9f-990b-d3cbcdd02186", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:04:51.115698 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-babb4e39-10e5-46c5-acab-d55c48f4dd36 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "72383914-4e53-4d9f-990b-d3cbcdd02186", "address": "fa:16:3e:06:2e:61", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72383914-4e", "ovs_interfaceid": "72383914-4e53-4d9f-990b-d3cbcdd02186", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:04:51.116416 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-babb4e39-10e5-46c5-acab-d55c48f4dd36 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:2e:61,bridge_name='br-int',has_traffic_filtering=True,id=72383914-4e53-4d9f-990b-d3cbcdd02186,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72383914-4e') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:04:51.116726 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-babb4e39-10e5-46c5-acab-d55c48f4dd36 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:2e:61,bridge_name='br-int',has_traffic_filtering=True,id=72383914-4e53-4d9f-990b-d3cbcdd02186,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72383914-4e') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:04:51.121943 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:51.122273 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72383914-4e, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:51.162789 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:51.165282 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:04:51.167898 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:51.169645 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:51.170018 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0c486a7-bd89-4269-b0cf-75ebffa86535) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:04:51.175118 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:51.177288 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:04:51.182598 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:51.189701 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-babb4e39-10e5-46c5-acab-d55c48f4dd36 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:2e:61,bridge_name='br-int',has_traffic_filtering=True,id=72383914-4e53-4d9f-990b-d3cbcdd02186,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72383914-4e') Jan 26 19:04:51.190022 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-babb4e39-10e5-46c5-acab-d55c48f4dd36 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Deleting instance files /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12_del Jan 26 19:04:51.190458 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-babb4e39-10e5-46c5-acab-d55c48f4dd36 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Deletion of /opt/stack/data/nova/instances/d9448760-8b72-4805-9dd0-368ccddaaa12_del complete Jan 26 19:04:51.642266 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:51.642502 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:51.646232 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:04:51.646434 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Claim successful on node np0005596550.novalocal Jan 26 19:04:51.705223 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-babb4e39-10e5-46c5-acab-d55c48f4dd36 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Took 1.37 seconds to destroy the instance on the hypervisor. Jan 26 19:04:51.705958 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-babb4e39-10e5-46c5-acab-d55c48f4dd36 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:04:51.706179 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:04:51.706309 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:04:51.706574 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:51.775261 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:51.973816 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-48942c34-23bb-40e8-a838-1cef319e6f57 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:52.007831 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:52.212321 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-0e857dd0-7476-4990-9689-93741659e5d2 req-81b6d0f2-4a1f-4eb7-91cf-756e8a9bb24b service nova] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Received event network-vif-deleted-72383914-4e53-4d9f-990b-d3cbcdd02186 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:04:52.212478 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-0e857dd0-7476-4990-9689-93741659e5d2 req-81b6d0f2-4a1f-4eb7-91cf-756e8a9bb24b service nova] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Neutron deleted interface 72383914-4e53-4d9f-990b-d3cbcdd02186; detaching it from the instance and deleting it from the info cache Jan 26 19:04:52.212622 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-0e857dd0-7476-4990-9689-93741659e5d2 req-81b6d0f2-4a1f-4eb7-91cf-756e8a9bb24b service nova] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:04:52.267179 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-48942c34-23bb-40e8-a838-1cef319e6f57 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:52.407256 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-48942c34-23bb-40e8-a838-1cef319e6f57 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Updating instance_info_cache with network_info: [{"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:04:52.617444 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-73f98e7e-c42e-4a32-b813-c96a1ee2515d req-4dd86fd8-a43d-496d-b8c8-bc49454b9feb service nova] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Received event network-vif-unplugged-72383914-4e53-4d9f-990b-d3cbcdd02186 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:04:52.617842 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-73f98e7e-c42e-4a32-b813-c96a1ee2515d req-4dd86fd8-a43d-496d-b8c8-bc49454b9feb service nova] Acquiring lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:52.618164 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-73f98e7e-c42e-4a32-b813-c96a1ee2515d req-4dd86fd8-a43d-496d-b8c8-bc49454b9feb service nova] Lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:52.618426 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-73f98e7e-c42e-4a32-b813-c96a1ee2515d req-4dd86fd8-a43d-496d-b8c8-bc49454b9feb service nova] Lock "d9448760-8b72-4805-9dd0-368ccddaaa12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:52.618895 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-73f98e7e-c42e-4a32-b813-c96a1ee2515d req-4dd86fd8-a43d-496d-b8c8-bc49454b9feb service nova] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] No waiting events found dispatching network-vif-unplugged-72383914-4e53-4d9f-990b-d3cbcdd02186 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:04:52.618998 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-73f98e7e-c42e-4a32-b813-c96a1ee2515d req-4dd86fd8-a43d-496d-b8c8-bc49454b9feb service nova] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Received event network-vif-unplugged-72383914-4e53-4d9f-990b-d3cbcdd02186 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:04:52.706320 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:04:52.721450 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-0e857dd0-7476-4990-9689-93741659e5d2 req-81b6d0f2-4a1f-4eb7-91cf-756e8a9bb24b service nova] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Detach interface failed, port_id=72383914-4e53-4d9f-990b-d3cbcdd02186, reason: Instance d9448760-8b72-4805-9dd0-368ccddaaa12 could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:04:52.919059 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-48942c34-23bb-40e8-a838-1cef319e6f57 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Releasing lock "refresh_cache-ca9a34ab-50c7-4278-b247-c7a7baeb5968" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:04:52.919059 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-48942c34-23bb-40e8-a838-1cef319e6f57 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'migration_context' on Instance uuid ca9a34ab-50c7-4278-b247-c7a7baeb5968 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:04:52.971657 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:04:53.213429 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Took 1.51 seconds to deallocate network for instance. Jan 26 19:04:53.421788 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-48942c34-23bb-40e8-a838-1cef319e6f57 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Object Instance lazy-loaded attributes: info_cache,migration_context {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:04:53.422905 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-48942c34-23bb-40e8-a838-1cef319e6f57 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:53.476124 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:04:53.727323 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-babb4e39-10e5-46c5-acab-d55c48f4dd36 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:53.986478 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.344s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:53.986998 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:04:53.990569 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-48942c34-23bb-40e8-a838-1cef319e6f57 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.568s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:54.524827 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Not allocating networking since 'none' was specified. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2039}} Jan 26 19:04:54.724626 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-48942c34-23bb-40e8-a838-1cef319e6f57 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:04:54.880938 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:04:54.881108 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] VM Stopped (Lifecycle Event) Jan 26 19:04:55.007902 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:04:55.228056 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-48942c34-23bb-40e8-a838-1cef319e6f57 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:04:55.384396 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a776bb50-7bc2-48bc-9990-a291315c2241 None None] [instance: 2305cb8a-e8df-49d9-b208-018af3c736f0] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:04:55.513302 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:04:56.229885 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:56.248708 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-48942c34-23bb-40e8-a838-1cef319e6f57 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.258s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:56.249179 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-48942c34-23bb-40e8-a838-1cef319e6f57 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Resized/migrated instance is powered off. Setting vm_state to 'stopped'. {{(pid=189076) _confirm_resize /opt/stack/nova/nova/compute/manager.py:5457}} Jan 26 19:04:56.257797 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-babb4e39-10e5-46c5-acab-d55c48f4dd36 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.528s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:56.258991 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-babb4e39-10e5-46c5-acab-d55c48f4dd36 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.005s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:56.303218 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-babb4e39-10e5-46c5-acab-d55c48f4dd36 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Deleted allocations for instance d9448760-8b72-4805-9dd0-368ccddaaa12 Jan 26 19:04:56.524927 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:04:56.525653 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:04:56.525945 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Creating image(s) Jan 26 19:04:56.526302 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Acquiring lock "/opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:56.526471 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "/opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:56.526997 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "/opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:56.527406 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:04:56.532012 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:04:56.534050 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:56.612500 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.079s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:56.612945 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:56.613438 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:56.614395 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:04:56.618564 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:04:56.618964 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:56.686008 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.066s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:56.686008 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:56.722853 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk 1073741824" returned: 0 in 0.037s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:56.724962 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.110s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:56.724962 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:56.815895 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.092s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:56.816307 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:04:56.816561 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:56.875714 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-48942c34-23bb-40e8-a838-1cef319e6f57 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Deleted allocation for migration 1a98122f-c500-4aa5-b3c1-d3ef0a7b5f2b Jan 26 19:04:56.919459 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:56.919694 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Cannot resize image /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:04:56.920001 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:04:56.920169 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Ensure instance console log exists: /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:04:56.920470 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:56.920685 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:56.920879 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:56.922071 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Start _get_guest_xml network_info=[] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:04:56.925051 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:04:56.926489 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServersListShow2100Test-server-1397460300', uuid='f08a5384-6c6a-4ba6-b624-21dd5468299b'), owner=OwnerMeta(userid='8b737dc7ba9f42aab786ac9bbbab6ebf', username='tempest-ServersListShow2100Test-1350606506-project-member', projectid='0b60d09919b44acf8ffbf428baa3f8a8', projectname='tempest-ServersListShow2100Test-1350606506'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[], nova_package='32.1.0', creation_time=1769472296.9261851) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:04:56.927886 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:04:56.928165 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:04:56.929760 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:04:56.930132 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:04:56.930933 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:04:56.931228 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:04:56.931422 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:04:56.931577 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:04:56.931725 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:04:56.931861 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:04:56.931972 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:04:56.932193 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:04:56.932324 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:04:56.932455 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:04:56.932590 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:04:56.932730 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:04:56.935473 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lazy-loading 'pci_devices' on Instance uuid f08a5384-6c6a-4ba6-b624-21dd5468299b {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:04:56.988005 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:04:57.329631 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-babb4e39-10e5-46c5-acab-d55c48f4dd36 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "d9448760-8b72-4805-9dd0-368ccddaaa12" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.518s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:57.384092 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-48942c34-23bb-40e8-a838-1cef319e6f57 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968" "released" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: held 6.995s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] End _get_guest_xml xml= Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: f08a5384-6c6a-4ba6-b624-21dd5468299b Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: instance-00000042 Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: tempest-ServersListShow2100Test-server-1397460300 Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:04:56 Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: tempest-ServersListShow2100Test-1350606506-project-member Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: tempest-ServersListShow2100Test-1350606506 Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: f08a5384-6c6a-4ba6-b624-21dd5468299b Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: f08a5384-6c6a-4ba6-b624-21dd5468299b Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: Jan 26 19:04:57.438358 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:04:58.044511 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'flavor' on Instance uuid ca9a34ab-50c7-4278-b247-c7a7baeb5968 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:04:58.557085 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "refresh_cache-ca9a34ab-50c7-4278-b247-c7a7baeb5968" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:04:58.557085 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquired lock "refresh_cache-ca9a34ab-50c7-4278-b247-c7a7baeb5968" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:04:58.557085 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:04:58.557085 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'info_cache' on Instance uuid ca9a34ab-50c7-4278-b247-c7a7baeb5968 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:04:58.935124 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:58.935485 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:04:58.969949 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:04:58.970331 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:04:58.971197 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Using config drive Jan 26 19:04:59.068618 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Object Instance lazy-loaded attributes: flavor,info_cache {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:04:59.438332 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:04:59.481610 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:59.522297 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Creating config drive at /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk.config Jan 26 19:04:59.525941 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp1d119udz {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:59.572284 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:59.679240 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp1d119udz" returned: 0 in 0.153s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:59.876702 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:04:59.896939 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:04:59.897146 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] VM Resumed (Lifecycle Event) Jan 26 19:04:59.901820 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Instance event wait completed in 0 seconds for {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:04:59.902039 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:04:59.907581 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Instance spawned successfully. Jan 26 19:04:59.907825 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:04:59.998249 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:04:59.998523 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:00.003361 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:05:00.003536 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Claim successful on node np0005596550.novalocal Jan 26 19:05:00.014043 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Updating instance_info_cache with network_info: [{"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:05:00.406296 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:00.406551 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:05:00.419911 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:00.419911 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:00.419911 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:00.419911 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:00.419911 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:00.419911 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:00.519642 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Releasing lock "refresh_cache-ca9a34ab-50c7-4278-b247-c7a7baeb5968" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:05:00.910345 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:05:00.910714 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:05:00.911131 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] VM Started (Lifecycle Event) Jan 26 19:05:00.928750 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Took 4.40 seconds to spawn the instance on the hypervisor. Jan 26 19:05:00.929098 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:01.281387 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:01.416602 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:01.419869 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:05:01.814907 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:05:01.924128 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:05:01.945179 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Took 10.34 seconds to build instance. Jan 26 19:05:01.988587 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:02.055574 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Instance destroyed successfully. Jan 26 19:05:02.056231 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'numa_topology' on Instance uuid ca9a34ab-50c7-4278-b247-c7a7baeb5968 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:05:02.320268 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:05:02.447431 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8b061d06-8dbc-44df-8b7c-7de1eef928d0 tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "f08a5384-6c6a-4ba6-b624-21dd5468299b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 11.859s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:02.560846 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Object Instance lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:05:02.561105 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'resources' on Instance uuid ca9a34ab-50c7-4278-b247-c7a7baeb5968 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:05:02.830804 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.832s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:02.831357 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:05:03.064466 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Object Instance lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:05:03.066698 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-612125545',display_name='tempest-ServerActionsTestOtherB-server-612125545',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-612125545',id=63,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK72/fZgFXc8Nm23qFp5bqxu5uQWjdqvi6tf0S8eHH5LAOejrjAG2pg3k7mvst6GtMR5cAEv++XPpoBWMRpc6kXyw3lb+Uukjxykolyr/SPF2WcEU8zRsEYayUYxi/WyQ==',key_name='tempest-keypair-56259378',keypairs=,launch_index=0,launched_at=2026-01-27T00:04:49Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=4,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-ffq07oni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=,task_state='powering-on',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=ca9a34ab-50c7-4278-b247-c7a7baeb5968,vcpu_model=,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:05:03.067300 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:05:03.069493 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ff:6f,bridge_name='br-int',has_traffic_filtering=True,id=7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eafe7fe-12') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:05:03.069493 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ff:6f,bridge_name='br-int',has_traffic_filtering=True,id=7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eafe7fe-12') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:05:03.072744 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:03.077846 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7eafe7fe-12, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:03.077846 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:03.081234 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:05:03.082541 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:03.083179 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c2a099a-b4db-471c-82a5-c17c20b52ba7) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:03.086342 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:03.086615 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:03.090761 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ff:6f,bridge_name='br-int',has_traffic_filtering=True,id=7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eafe7fe-12') Jan 26 19:05:03.100805 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Start _get_guest_xml network_info=[{"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:05:03.103308 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:05:03.104602 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-612125545', uuid='ca9a34ab-50c7-4278-b247-c7a7baeb5968'), owner=OwnerMeta(userid='8369268788c24337ade1739d948c300a', username='tempest-ServerActionsTestOtherB-1262198412-project-member', projectid='8428b9d1e48c42f690612bf1e012ec42', projectname='tempest-ServerActionsTestOtherB-1262198412'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472303.1042178) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:05:03.107454 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:05:03.107893 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:05:03.108986 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:05:03.109401 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:05:03.110554 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:05:03.110940 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:05:03.113915 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:05:03.113915 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:05:03.113915 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:05:03.113915 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:05:03.113915 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:05:03.113915 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:05:03.113915 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:05:03.113915 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:05:03.113915 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:05:03.113915 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:05:03.113915 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'vcpu_model' on Instance uuid ca9a34ab-50c7-4278-b247-c7a7baeb5968 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:05:03.342512 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:05:03.342758 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:05:03.344287 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:03.344287 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:03.457355 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25c3c9ca754941ccbd986028c2a87e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efcb8570b994820a5956fab4e859054', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:05:03.616022 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Object Instance lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:05:03.626669 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-612125545',display_name='tempest-ServerActionsTestOtherB-server-612125545',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-612125545',id=63,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK72/fZgFXc8Nm23qFp5bqxu5uQWjdqvi6tf0S8eHH5LAOejrjAG2pg3k7mvst6GtMR5cAEv++XPpoBWMRpc6kXyw3lb+Uukjxykolyr/SPF2WcEU8zRsEYayUYxi/WyQ==',key_name='tempest-keypair-56259378',keypairs=,launch_index=0,launched_at=2026-01-27T00:04:49Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=4,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-ffq07oni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=,task_state='powering-on',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=ca9a34ab-50c7-4278-b247-c7a7baeb5968,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:05:03.627261 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:05:03.628447 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ff:6f,bridge_name='br-int',has_traffic_filtering=True,id=7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eafe7fe-12') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:05:03.629924 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'pci_devices' on Instance uuid ca9a34ab-50c7-4278-b247-c7a7baeb5968 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:05:03.789864 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:03.870913 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:05:03.969524 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Successfully created port: fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:05:04.133037 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Object Instance lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] End _get_guest_xml xml= Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: ca9a34ab-50c7-4278-b247-c7a7baeb5968 Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: instance-0000003f Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: 262144 Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-server-612125545 Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:05:03 Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: 256 Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: ide Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: pc Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-1262198412-project-member Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-1262198412 Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: ca9a34ab-50c7-4278-b247-c7a7baeb5968 Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: ca9a34ab-50c7-4278-b247-c7a7baeb5968 Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:04.134146 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:05:04.135875 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:04.258456 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:04.258888 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:04.351605 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:04.352244 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'trusted_certs' on Instance uuid ca9a34ab-50c7-4278-b247-c7a7baeb5968 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:05:04.382198 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:05:04.438270 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Successfully updated port: fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:05:04.474360 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a51efcf9-d8ad-4626-80d3-7a38208a22c9 req-e7ff47fa-d2ae-4dd0-9d3f-3b035a0b8d32 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received event network-changed-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:05:04.474360 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a51efcf9-d8ad-4626-80d3-7a38208a22c9 req-e7ff47fa-d2ae-4dd0-9d3f-3b035a0b8d32 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Refreshing instance network info cache due to event network-changed-fe2a5eb1-3745-4099-b530-b2e55ec11296. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:05:04.474594 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a51efcf9-d8ad-4626-80d3-7a38208a22c9 req-e7ff47fa-d2ae-4dd0-9d3f-3b035a0b8d32 service nova] Acquiring lock "refresh_cache-48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:05:04.474785 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a51efcf9-d8ad-4626-80d3-7a38208a22c9 req-e7ff47fa-d2ae-4dd0-9d3f-3b035a0b8d32 service nova] Acquired lock "refresh_cache-48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:05:04.475087 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-a51efcf9-d8ad-4626-80d3-7a38208a22c9 req-e7ff47fa-d2ae-4dd0-9d3f-3b035a0b8d32 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Refreshing network info cache for port fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:05:04.855679 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Object Instance lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:05:04.856052 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:04.934509 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.078s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:04.934747 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:05:04.935008 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:04.945152 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "refresh_cache-48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:05:04.977570 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-a51efcf9-d8ad-4626-80d3-7a38208a22c9 req-e7ff47fa-d2ae-4dd0-9d3f-3b035a0b8d32 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:05.010624 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:05.011026 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Cannot resize image /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:05:05.011309 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'migration_context' on Instance uuid ca9a34ab-50c7-4278-b247-c7a7baeb5968 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:05:05.017906 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Rebuilding instance Jan 26 19:05:05.045145 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-a51efcf9-d8ad-4626-80d3-7a38208a22c9 req-e7ff47fa-d2ae-4dd0-9d3f-3b035a0b8d32 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:05:05.173099 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:05.193408 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-a51efcf9-d8ad-4626-80d3-7a38208a22c9 req-e7ff47fa-d2ae-4dd0-9d3f-3b035a0b8d32 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:05:05.399414 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:05:05.401237 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:05:05.402077 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Creating image(s) Jan 26 19:05:05.403114 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "/opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:05.403521 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "/opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:05.404960 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "/opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:05.406507 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:05.423807 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:05.423807 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:05.516723 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Object Instance lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:05:05.518094 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-612125545',display_name='tempest-ServerActionsTestOtherB-server-612125545',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-612125545',id=63,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK72/fZgFXc8Nm23qFp5bqxu5uQWjdqvi6tf0S8eHH5LAOejrjAG2pg3k7mvst6GtMR5cAEv++XPpoBWMRpc6kXyw3lb+Uukjxykolyr/SPF2WcEU8zRsEYayUYxi/WyQ==',key_name='tempest-keypair-56259378',keypairs=,launch_index=0,launched_at=2026-01-27T00:04:49Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=,power_state=4,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-ffq07oni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=ca9a34ab-50c7-4278-b247-c7a7baeb5968,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:05:05.518373 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:05:05.519169 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ff:6f,bridge_name='br-int',has_traffic_filtering=True,id=7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eafe7fe-12') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:05:05.519587 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ff:6f,bridge_name='br-int',has_traffic_filtering=True,id=7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eafe7fe-12') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:05:05.520049 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.098s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:05.520465 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:05.520930 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:05.521356 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:05.525664 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:05.525664 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:05.532244 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:05.533096 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:05.533683 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:05:05.535317 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:05.535624 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fddbf34b-094e-5557-b6df-1177a6ec5498', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:05.580977 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:05.583712 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:05:05.584471 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:05.587646 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:05.587963 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7eafe7fe-12, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:05.588540 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7eafe7fe-12, col_values=(('qos', UUID('29238bb3-5758-409a-a983-3667ca3c6bb9')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:05.588836 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7eafe7fe-12, col_values=(('external_ids', {'iface-id': '7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:ff:6f', 'vm-uuid': 'ca9a34ab-50c7-4278-b247-c7a7baeb5968'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:05.590080 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:05.593380 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:05:05.597451 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:05.598996 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ff:6f,bridge_name='br-int',has_traffic_filtering=True,id=7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eafe7fe-12') Jan 26 19:05:05.609066 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:05:05.609272 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] VM Stopped (Lifecycle Event) Jan 26 19:05:05.649736 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.124s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:05.650225 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:05.680052 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:05.687192 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:05.699943 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a51efcf9-d8ad-4626-80d3-7a38208a22c9 req-e7ff47fa-d2ae-4dd0-9d3f-3b035a0b8d32 service nova] Releasing lock "refresh_cache-48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:05:05.700651 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquired lock "refresh_cache-48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:05:05.702251 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:05:05.704593 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk 1073741824" returned: 0 in 0.054s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:05.705915 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.184s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:05.705915 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:05.781861 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.073s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:05.781861 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:05:05.781861 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:05.819036 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:05.820441 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:05.842810 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:05:05.842810 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] VM Resumed (Lifecycle Event) Jan 26 19:05:05.844714 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Instance event wait completed in 0 seconds for {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:05:05.855160 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Instance rebooted successfully. Jan 26 19:05:05.867010 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:05.867291 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Cannot resize image /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:05:05.867533 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:05:05.867713 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Ensure instance console log exists: /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:05:05.868013 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:05.868216 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:05.868366 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:06.114669 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-72f1b0ce-54f5-476b-96ae-0b7c4586c1ae None None] [instance: d9448760-8b72-4805-9dd0-368ccddaaa12] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:06.262394 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:05:06.356184 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:06.366898 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:05:06.376363 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:06.435677 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Instance destroyed successfully. Jan 26 19:05:06.440485 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Instance destroyed successfully. Jan 26 19:05:06.440736 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Deleting instance files /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b_del Jan 26 19:05:06.441279 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Deletion of /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b_del complete Jan 26 19:05:06.510503 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b2a6beda-5fa6-4d7b-b375-e384ce16671d req-49b78c84-5126-4f93-8c5a-a8f2de1d1718 service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Received event network-vif-plugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:05:06.510666 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b2a6beda-5fa6-4d7b-b375-e384ce16671d req-49b78c84-5126-4f93-8c5a-a8f2de1d1718 service nova] Acquiring lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:06.510874 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b2a6beda-5fa6-4d7b-b375-e384ce16671d req-49b78c84-5126-4f93-8c5a-a8f2de1d1718 service nova] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:06.511023 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b2a6beda-5fa6-4d7b-b375-e384ce16671d req-49b78c84-5126-4f93-8c5a-a8f2de1d1718 service nova] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:06.511167 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b2a6beda-5fa6-4d7b-b375-e384ce16671d req-49b78c84-5126-4f93-8c5a-a8f2de1d1718 service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] No waiting events found dispatching network-vif-plugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:05:06.511315 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-b2a6beda-5fa6-4d7b-b375-e384ce16671d req-49b78c84-5126-4f93-8c5a-a8f2de1d1718 service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Received unexpected event network-vif-plugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c for instance with vm_state stopped and task_state powering-on. Jan 26 19:05:06.511944 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b2a6beda-5fa6-4d7b-b375-e384ce16671d req-49b78c84-5126-4f93-8c5a-a8f2de1d1718 service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Received event network-vif-plugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:05:06.511944 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b2a6beda-5fa6-4d7b-b375-e384ce16671d req-49b78c84-5126-4f93-8c5a-a8f2de1d1718 service nova] Acquiring lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:06.511944 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b2a6beda-5fa6-4d7b-b375-e384ce16671d req-49b78c84-5126-4f93-8c5a-a8f2de1d1718 service nova] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:06.511944 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b2a6beda-5fa6-4d7b-b375-e384ce16671d req-49b78c84-5126-4f93-8c5a-a8f2de1d1718 service nova] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:06.512059 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b2a6beda-5fa6-4d7b-b375-e384ce16671d req-49b78c84-5126-4f93-8c5a-a8f2de1d1718 service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] No waiting events found dispatching network-vif-plugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:05:06.512480 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-b2a6beda-5fa6-4d7b-b375-e384ce16671d req-49b78c84-5126-4f93-8c5a-a8f2de1d1718 service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Received unexpected event network-vif-plugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c for instance with vm_state stopped and task_state powering-on. Jan 26 19:05:06.522044 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Updating instance_info_cache with network_info: [{"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:05:06.869653 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] During sync_power_state the instance has a pending task (powering-on). Skip. Jan 26 19:05:06.872313 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:05:06.872313 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] VM Started (Lifecycle Event) Jan 26 19:05:06.989744 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:07.024112 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Releasing lock "refresh_cache-48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:05:07.024465 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Instance network_info: |[{"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:05:07.026886 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Start _get_guest_xml network_info=[{"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:05:07.031326 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:05:07.032539 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestJSON-server-469643394', uuid='48ff5e37-56fe-46a8-b14c-8e4cf3197fb5'), owner=OwnerMeta(userid='25c3c9ca754941ccbd986028c2a87e07', username='tempest-ServerActionsTestJSON-960489083-project-member', projectid='2efcb8570b994820a5956fab4e859054', projectname='tempest-ServerActionsTestJSON-960489083'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472307.032173) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:05:07.034818 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:05:07.034818 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:05:07.036253 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:05:07.036688 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:05:07.037827 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:05:07.038233 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:05:07.038453 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:05:07.038628 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:05:07.039124 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:05:07.039124 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:05:07.039245 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:05:07.039484 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:05:07.039649 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:05:07.039904 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:05:07.040092 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:05:07.040288 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:05:07.043686 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-469643394',display_name='tempest-ServerActionsTestJSON-server-469643394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestjson-server-469643394',id=67,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaqJcAWtBvnDQt3Z0Zs2SEk8GmS4qswJn8I3pLNnZ26AiUp6izAb2VATu7Ta6RkUjooYd/ncwVnO6h5/K851Ht4DSyJ8eVOthZpoT3zQfgSsI2MjV6hMkI8XyrAdvV6PQ==',key_name='tempest-keypair-571396453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-v7nt6kx2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:05:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=48ff5e37-56fe-46a8-b14c-8e4cf3197fb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:05:07.043939 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:05:07.044557 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:69,bridge_name='br-int',has_traffic_filtering=True,id=fe2a5eb1-3745-4099-b530-b2e55ec11296,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2a5eb1-37') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:05:07.045197 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'pci_devices' on Instance uuid 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:05:07.367633 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:05:07.368063 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:05:07.368063 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No VIF found with MAC fa:16:3e:5b:ff:6f, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:05:07.368345 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c62afe4a-ea31-4bec-985e-a76b61c26c3f tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:07.375190 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:07.377094 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] End _get_guest_xml xml= Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5 Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: instance-00000043 Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestJSON-server-469643394 Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:05:07 Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestJSON-960489083-project-member Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestJSON-960489083 Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5 Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5 Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:07.548446 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:05:07.550269 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Preparing to wait for external event network-vif-plugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:05:07.550269 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:07.550269 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:07.550269 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:07.550269 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-469643394',display_name='tempest-ServerActionsTestJSON-server-469643394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestjson-server-469643394',id=67,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaqJcAWtBvnDQt3Z0Zs2SEk8GmS4qswJn8I3pLNnZ26AiUp6izAb2VATu7Ta6RkUjooYd/ncwVnO6h5/K851Ht4DSyJ8eVOthZpoT3zQfgSsI2MjV6hMkI8XyrAdvV6PQ==',key_name='tempest-keypair-571396453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-v7nt6kx2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:05:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=48ff5e37-56fe-46a8-b14c-8e4cf3197fb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:05:07.550477 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:05:07.550477 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:69,bridge_name='br-int',has_traffic_filtering=True,id=fe2a5eb1-3745-4099-b530-b2e55ec11296,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2a5eb1-37') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:05:07.553958 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:69,bridge_name='br-int',has_traffic_filtering=True,id=fe2a5eb1-3745-4099-b530-b2e55ec11296,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2a5eb1-37') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:05:07.553958 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:07.553958 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:07.553958 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:05:07.553958 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:07.553958 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8a316f4-72ff-58a7-81e7-47dcdf74e3a4', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:07.553958 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:07.555119 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:05:07.558231 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:07.565356 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:07.565588 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe2a5eb1-37, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:07.565926 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe2a5eb1-37, col_values=(('qos', UUID('7a37f426-838a-4997-ba97-f0823141ecea')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:07.566147 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe2a5eb1-37, col_values=(('external_ids', {'iface-id': 'fe2a5eb1-3745-4099-b530-b2e55ec11296', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:fd:69', 'vm-uuid': '48ff5e37-56fe-46a8-b14c-8e4cf3197fb5'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:07.567056 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:07.569658 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:05:07.574491 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:07.575260 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:69,bridge_name='br-int',has_traffic_filtering=True,id=fe2a5eb1-3745-4099-b530-b2e55ec11296,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2a5eb1-37') Jan 26 19:05:07.885498 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] During sync_power_state the instance has a pending task (powering-on). Skip. Jan 26 19:05:07.968642 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:05:07.969313 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Creating image(s) Jan 26 19:05:07.970151 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Acquiring lock "/opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:07.970466 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "/opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:07.971365 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "/opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:07.972244 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:07.978057 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:07.980120 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:08.072622 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json" returned: 0 in 0.092s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:08.073302 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Acquiring lock "791283f4306f6266c365d052f132d740f0c9b85f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:08.074107 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "791283f4306f6266c365d052f132d740f0c9b85f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:08.079610 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:08.089904 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:08.090423 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:08.175658 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json" returned: 0 in 0.085s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:08.175996 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f,backing_fmt=raw /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:08.214202 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f,backing_fmt=raw /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk 1073741824" returned: 0 in 0.038s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:08.214681 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "791283f4306f6266c365d052f132d740f0c9b85f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.141s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:08.215119 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:08.298866 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json" returned: 0 in 0.083s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:08.299351 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:05:08.299654 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:08.379181 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:08.379985 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Cannot resize image /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:05:08.380874 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:05:08.381357 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Ensure instance console log exists: /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:05:08.382108 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:08.382790 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:08.383085 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:08.385817 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Start _get_guest_xml network_info=[] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-01-26T23:49:28Z,direct_url=,disk_format='qcow2',id=bd70f82e-84e0-4042-ad07-7b834bb8ac38,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-01-26T23:49:31Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:05:08.392534 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError Jan 26 19:05:08.394747 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bd70f82e-84e0-4042-ad07-7b834bb8ac38', instance_meta=NovaInstanceMeta(name='tempest-ServersListShow2100Test-server-1397460300', uuid='f08a5384-6c6a-4ba6-b624-21dd5468299b'), owner=OwnerMeta(userid='8b737dc7ba9f42aab786ac9bbbab6ebf', username='tempest-ServersListShow2100Test-1350606506-project-member', projectid='0b60d09919b44acf8ffbf428baa3f8a8', projectname='tempest-ServersListShow2100Test-1350606506'), image=ImageMeta(id='bd70f82e-84e0-4042-ad07-7b834bb8ac38', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[], nova_package='32.1.0', creation_time=1769472308.3941984) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:05:08.398090 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:05:08.398731 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:05:08.403302 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:05:08.403720 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:05:08.405529 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:05:08.406241 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-01-26T23:49:28Z,direct_url=,disk_format='qcow2',id=bd70f82e-84e0-4042-ad07-7b834bb8ac38,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-01-26T23:49:31Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:05:08.406709 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:05:08.407074 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:05:08.407448 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:05:08.407752 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:05:08.408160 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:05:08.408555 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:05:08.408884 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:05:08.409261 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:05:08.409601 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:05:08.410065 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:05:08.410535 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lazy-loading 'vcpu_model' on Instance uuid f08a5384-6c6a-4ba6-b624-21dd5468299b {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:05:08.433703 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-212ce881-f856-4d5d-af7e-8b6e4c38b177 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:08.434022 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-212ce881-f856-4d5d-af7e-8b6e4c38b177 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:08.434117 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-212ce881-f856-4d5d-af7e-8b6e4c38b177 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:08.434277 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-212ce881-f856-4d5d-af7e-8b6e4c38b177 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:08.434457 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-212ce881-f856-4d5d-af7e-8b6e4c38b177 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:08.438381 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-212ce881-f856-4d5d-af7e-8b6e4c38b177 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Terminating instance Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] End _get_guest_xml xml= Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: f08a5384-6c6a-4ba6-b624-21dd5468299b Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: instance-00000042 Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: tempest-ServersListShow2100Test-server-1397460300 Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:05:08 Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: tempest-ServersListShow2100Test-1350606506-project-member Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: tempest-ServersListShow2100Test-1350606506 Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: f08a5384-6c6a-4ba6-b624-21dd5468299b Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: f08a5384-6c6a-4ba6-b624-21dd5468299b Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:08.919168 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:05:08.945987 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-212ce881-f856-4d5d-af7e-8b6e4c38b177 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:05:09.005179 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:09.005179 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:09.007401 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:09.106025 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:09.117176 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:09.121224 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-76c9d3b3-84b2-47cb-a321-c00b033c85cf req-bcac6564-9db3-4ee8-9d47-9c3a433a54a2 service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Received event network-vif-unplugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:05:09.121392 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-76c9d3b3-84b2-47cb-a321-c00b033c85cf req-bcac6564-9db3-4ee8-9d47-9c3a433a54a2 service nova] Acquiring lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:09.121561 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-76c9d3b3-84b2-47cb-a321-c00b033c85cf req-bcac6564-9db3-4ee8-9d47-9c3a433a54a2 service nova] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:09.121704 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-76c9d3b3-84b2-47cb-a321-c00b033c85cf req-bcac6564-9db3-4ee8-9d47-9c3a433a54a2 service nova] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:09.122167 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-76c9d3b3-84b2-47cb-a321-c00b033c85cf req-bcac6564-9db3-4ee8-9d47-9c3a433a54a2 service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] No waiting events found dispatching network-vif-unplugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:05:09.122351 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-76c9d3b3-84b2-47cb-a321-c00b033c85cf req-bcac6564-9db3-4ee8-9d47-9c3a433a54a2 service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Received event network-vif-unplugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:05:09.128865 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:05:09.129070 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:05:09.129264 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] No VIF found with MAC fa:16:3e:9b:fd:69, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:05:09.129818 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Using config drive Jan 26 19:05:09.172537 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:09.181230 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:09.219553 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Instance destroyed successfully. Jan 26 19:05:09.219997 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-212ce881-f856-4d5d-af7e-8b6e4c38b177 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'resources' on Instance uuid ca9a34ab-50c7-4278-b247-c7a7baeb5968 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:05:09.638642 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:09.718092 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Creating config drive at /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk.config Jan 26 19:05:09.721615 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpdptytz1z {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:09.729749 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-212ce881-f856-4d5d-af7e-8b6e4c38b177 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-612125545',display_name='tempest-ServerActionsTestOtherB-server-612125545',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-612125545',id=63,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK72/fZgFXc8Nm23qFp5bqxu5uQWjdqvi6tf0S8eHH5LAOejrjAG2pg3k7mvst6GtMR5cAEv++XPpoBWMRpc6kXyw3lb+Uukjxykolyr/SPF2WcEU8zRsEYayUYxi/WyQ==',key_name='tempest-keypair-56259378',keypairs=,launch_index=0,launched_at=2026-01-27T00:04:49Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-ffq07oni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:05:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=ca9a34ab-50c7-4278-b247-c7a7baeb5968,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:05:09.730018 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-212ce881-f856-4d5d-af7e-8b6e4c38b177 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "address": "fa:16:3e:5b:ff:6f", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eafe7fe-12", "ovs_interfaceid": "7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:05:09.732298 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-212ce881-f856-4d5d-af7e-8b6e4c38b177 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ff:6f,bridge_name='br-int',has_traffic_filtering=True,id=7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eafe7fe-12') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:05:09.732615 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-212ce881-f856-4d5d-af7e-8b6e4c38b177 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ff:6f,bridge_name='br-int',has_traffic_filtering=True,id=7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eafe7fe-12') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:05:09.734209 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:09.734660 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7eafe7fe-12, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:09.739266 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:05:09.744030 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:09.745039 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:09.745358 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29238bb3-5758-409a-a983-3667ca3c6bb9) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:09.748001 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:05:09.751489 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:09.753686 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-212ce881-f856-4d5d-af7e-8b6e4c38b177 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ff:6f,bridge_name='br-int',has_traffic_filtering=True,id=7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eafe7fe-12') Jan 26 19:05:09.754132 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-212ce881-f856-4d5d-af7e-8b6e4c38b177 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Deleting instance files /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968_del Jan 26 19:05:09.754739 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-212ce881-f856-4d5d-af7e-8b6e4c38b177 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Deletion of /opt/stack/data/nova/instances/ca9a34ab-50c7-4278-b247-c7a7baeb5968_del complete Jan 26 19:05:09.841287 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpdptytz1z" returned: 0 in 0.120s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:09.889048 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:09.894884 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:09.906534 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:10.044075 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5ea1bffe-95a5-4b9e-a1de-9a2f9bdc39c6 req-dbdbed39-bff1-43a2-919a-2d19794ce66f service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received event network-vif-plugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:05:10.044075 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5ea1bffe-95a5-4b9e-a1de-9a2f9bdc39c6 req-dbdbed39-bff1-43a2-919a-2d19794ce66f service nova] Acquiring lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:10.044075 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5ea1bffe-95a5-4b9e-a1de-9a2f9bdc39c6 req-dbdbed39-bff1-43a2-919a-2d19794ce66f service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:10.044075 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5ea1bffe-95a5-4b9e-a1de-9a2f9bdc39c6 req-dbdbed39-bff1-43a2-919a-2d19794ce66f service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:10.044075 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5ea1bffe-95a5-4b9e-a1de-9a2f9bdc39c6 req-dbdbed39-bff1-43a2-919a-2d19794ce66f service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Processing event network-vif-plugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:05:10.052745 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:05:10.053120 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] VM Started (Lifecycle Event) Jan 26 19:05:10.054857 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:05:10.060312 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:05:10.066731 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Instance spawned successfully. Jan 26 19:05:10.068409 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:05:10.246251 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:10.249263 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:10.256564 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:10.259243 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:10.272507 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-212ce881-f856-4d5d-af7e-8b6e4c38b177 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Took 1.33 seconds to destroy the instance on the hypervisor. Jan 26 19:05:10.272847 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-212ce881-f856-4d5d-af7e-8b6e4c38b177 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:05:10.273062 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:05:10.273242 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:05:10.274506 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:10.326959 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:10.448440 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:05:10.448572 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:05:10.449080 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Using config drive Jan 26 19:05:10.557369 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:10.561901 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:05:10.586578 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:10.587567 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:10.588088 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:10.588799 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:10.589319 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:10.590982 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:10.896062 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:05:10.954526 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lazy-loading 'ec2_ids' on Instance uuid f08a5384-6c6a-4ba6-b624-21dd5468299b {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:05:11.068204 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:05:11.068324 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:05:11.069801 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] VM Paused (Lifecycle Event) Jan 26 19:05:11.099248 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Took 5.70 seconds to spawn the instance on the hypervisor. Jan 26 19:05:11.099446 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:11.152970 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-db296fa7-7e83-4c34-a61b-3fe0d892160b req-5f685329-897f-46f4-84cb-9d742668b3f5 service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Received event network-vif-unplugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:05:11.153145 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-db296fa7-7e83-4c34-a61b-3fe0d892160b req-5f685329-897f-46f4-84cb-9d742668b3f5 service nova] Acquiring lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:11.153508 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-db296fa7-7e83-4c34-a61b-3fe0d892160b req-5f685329-897f-46f4-84cb-9d742668b3f5 service nova] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:11.153643 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-db296fa7-7e83-4c34-a61b-3fe0d892160b req-5f685329-897f-46f4-84cb-9d742668b3f5 service nova] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:11.153842 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-db296fa7-7e83-4c34-a61b-3fe0d892160b req-5f685329-897f-46f4-84cb-9d742668b3f5 service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] No waiting events found dispatching network-vif-unplugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:05:11.153982 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-db296fa7-7e83-4c34-a61b-3fe0d892160b req-5f685329-897f-46f4-84cb-9d742668b3f5 service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Received event network-vif-unplugged-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:05:11.273933 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:05:11.458811 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Object Instance lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:05:11.458959 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lazy-loading 'keypairs' on Instance uuid f08a5384-6c6a-4ba6-b624-21dd5468299b {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:05:11.572996 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:11.577060 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:05:11.577238 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] VM Resumed (Lifecycle Event) Jan 26 19:05:11.611787 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Took 11.66 seconds to build instance. Jan 26 19:05:11.778513 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Took 1.50 seconds to deallocate network for instance. Jan 26 19:05:11.895097 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:05:11.962300 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Object Instance lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:05:11.966706 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError Jan 26 19:05:11.992758 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:12.033229 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Creating config drive at /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk.config Jan 26 19:05:12.042651 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp0ag9stov {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:12.084591 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:12.088258 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:05:12.118509 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6648b017-920e-46c6-aa56-990d243b9a5a tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 13.183s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:12.121069 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-83efa98e-9119-4050-a77c-b532ee3c65a6 req-5269c63e-3e7c-4e1d-a6b5-6e31f3656921 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received event network-vif-plugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:05:12.121285 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-83efa98e-9119-4050-a77c-b532ee3c65a6 req-5269c63e-3e7c-4e1d-a6b5-6e31f3656921 service nova] Acquiring lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:12.121454 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-83efa98e-9119-4050-a77c-b532ee3c65a6 req-5269c63e-3e7c-4e1d-a6b5-6e31f3656921 service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:12.121651 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-83efa98e-9119-4050-a77c-b532ee3c65a6 req-5269c63e-3e7c-4e1d-a6b5-6e31f3656921 service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:12.121825 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-83efa98e-9119-4050-a77c-b532ee3c65a6 req-5269c63e-3e7c-4e1d-a6b5-6e31f3656921 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] No waiting events found dispatching network-vif-plugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:05:12.121934 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-83efa98e-9119-4050-a77c-b532ee3c65a6 req-5269c63e-3e7c-4e1d-a6b5-6e31f3656921 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received unexpected event network-vif-plugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 for instance with vm_state active and task_state None. Jan 26 19:05:12.122063 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-83efa98e-9119-4050-a77c-b532ee3c65a6 req-5269c63e-3e7c-4e1d-a6b5-6e31f3656921 service nova] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Received event network-vif-deleted-7eafe7fe-1251-4542-8c0c-0d2bb26d3e1c {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:05:12.164463 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp0ag9stov" returned: 0 in 0.125s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:12.287382 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-212ce881-f856-4d5d-af7e-8b6e4c38b177 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:12.287752 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-212ce881-f856-4d5d-af7e-8b6e4c38b177 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:12.290531 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-212ce881-f856-4d5d-af7e-8b6e4c38b177 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.003s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:12.371648 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-212ce881-f856-4d5d-af7e-8b6e4c38b177 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Deleted allocations for instance ca9a34ab-50c7-4278-b247-c7a7baeb5968 Jan 26 19:05:12.381212 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Instance event wait completed in 0 seconds for {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:05:12.381833 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:05:12.388368 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Instance spawned successfully. Jan 26 19:05:12.388888 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:05:12.591559 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for f08a5384-6c6a-4ba6-b624-21dd5468299b due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:05:12.591873 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:05:12.592876 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] VM Resumed (Lifecycle Event) Jan 26 19:05:12.896635 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:05:12.909336 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:12.911375 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:12.911915 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:12.912249 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:12.914416 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:12.914877 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:13.095343 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:13.100556 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:05:13.192249 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-21ac84cc-2d69-4f38-943c-57c6799bc254 req-3f3d492e-aed5-4aaf-b091-e18f37adc930 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received event network-changed-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:05:13.192379 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-21ac84cc-2d69-4f38-943c-57c6799bc254 req-3f3d492e-aed5-4aaf-b091-e18f37adc930 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Refreshing instance network info cache due to event network-changed-fe2a5eb1-3745-4099-b530-b2e55ec11296. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:05:13.193004 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-21ac84cc-2d69-4f38-943c-57c6799bc254 req-3f3d492e-aed5-4aaf-b091-e18f37adc930 service nova] Acquiring lock "refresh_cache-48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:05:13.193157 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-21ac84cc-2d69-4f38-943c-57c6799bc254 req-3f3d492e-aed5-4aaf-b091-e18f37adc930 service nova] Acquired lock "refresh_cache-48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:05:13.193372 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-21ac84cc-2d69-4f38-943c-57c6799bc254 req-3f3d492e-aed5-4aaf-b091-e18f37adc930 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Refreshing network info cache for port fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:05:13.381982 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-212ce881-f856-4d5d-af7e-8b6e4c38b177 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "ca9a34ab-50c7-4278-b247-c7a7baeb5968" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 4.948s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:13.410726 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:13.410963 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:13.411169 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:13.411831 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:05:13.424033 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:13.611850 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] During sync_power_state the instance has a pending task (rebuild_spawning). Skip. Jan 26 19:05:13.612207 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:05:13.612537 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] VM Started (Lifecycle Event) Jan 26 19:05:13.696367 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-21ac84cc-2d69-4f38-943c-57c6799bc254 req-3f3d492e-aed5-4aaf-b091-e18f37adc930 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:13.948541 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:13.948679 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:13.948814 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Trying to apply a migration context that does not seem to be set for this instance {{(pid=189076) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}} Jan 26 19:05:13.965290 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-21ac84cc-2d69-4f38-943c-57c6799bc254 req-3f3d492e-aed5-4aaf-b091-e18f37adc930 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:14.076602 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-21ac84cc-2d69-4f38-943c-57c6799bc254 req-3f3d492e-aed5-4aaf-b091-e18f37adc930 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Updated VIF entry in instance network info cache for port fe2a5eb1-3745-4099-b530-b2e55ec11296. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:05:14.076602 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-21ac84cc-2d69-4f38-943c-57c6799bc254 req-3f3d492e-aed5-4aaf-b091-e18f37adc930 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Updating instance_info_cache with network_info: [{"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:05:14.116592 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:14.123187 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:05:14.468558 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:14.553999 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:14.559010 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:14.582676 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-21ac84cc-2d69-4f38-943c-57c6799bc254 req-3f3d492e-aed5-4aaf-b091-e18f37adc930 service nova] Releasing lock "refresh_cache-48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:05:14.625979 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] During sync_power_state the instance has a pending task (deleting). Skip. Jan 26 19:05:14.637871 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Acquiring lock "f08a5384-6c6a-4ba6-b624-21dd5468299b" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:14.637871 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "f08a5384-6c6a-4ba6-b624-21dd5468299b" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:14.637871 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Acquiring lock "f08a5384-6c6a-4ba6-b624-21dd5468299b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:14.637871 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "f08a5384-6c6a-4ba6-b624-21dd5468299b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:14.637871 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "f08a5384-6c6a-4ba6-b624-21dd5468299b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:14.640528 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Terminating instance Jan 26 19:05:14.650940 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:14.663198 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:14.741022 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:14.741850 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:14.750077 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:14.831216 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:14.836093 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:14.942231 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:14.942657 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:14.963000 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-5a0397fc-9508-434b-85b6-07f2478a008d tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.014s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:15.022893 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:15.071505 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:15.072913 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:15.136644 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:05:15.138273 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:15.147622 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Acquiring lock "refresh_cache-f08a5384-6c6a-4ba6-b624-21dd5468299b" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:05:15.147798 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Acquired lock "refresh_cache-f08a5384-6c6a-4ba6-b624-21dd5468299b" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:05:15.148020 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:05:15.159680 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.022s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:15.159929 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=7438MB free_disk=373.45665740966797GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:05:15.160070 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:15.160418 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:15.577441 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:05:15.654159 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:15.693470 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:05:15.793621 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:05:16.120141 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:16.205412 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance d0ddb554-76ed-49a6-a02b-042680eb310d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:05:16.205818 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance f08a5384-6c6a-4ba6-b624-21dd5468299b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:05:16.206180 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:05:16.296529 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Releasing lock "refresh_cache-f08a5384-6c6a-4ba6-b624-21dd5468299b" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:05:16.296911 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:05:16.579481 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Instance destroyed successfully. Jan 26 19:05:16.580101 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lazy-loading 'resources' on Instance uuid f08a5384-6c6a-4ba6-b624-21dd5468299b {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:05:16.673966 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "e6131b49-ccfa-43e4-9480-76d9062c4e48" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:16.673966 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "e6131b49-ccfa-43e4-9480-76d9062c4e48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:16.710605 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}} Jan 26 19:05:16.710790 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 3 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:05:16.710911 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=1088MB phys_disk=399GB used_disk=3GB total_vcpus=8 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:05:15 up 33 min, 13 users, load average: 5.77, 5.14, 3.66\n', 'num_instances': '3', 'num_vm_active': '3', 'num_task_None': '2', 'num_os_type_None': '3', 'num_proj_8428b9d1e48c42f690612bf1e012ec42': '1', 'io_workload': '0', 'num_proj_2efcb8570b994820a5956fab4e859054': '1', 'num_task_deleting': '1', 'num_proj_0b60d09919b44acf8ffbf428baa3f8a8': '1'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:05:16.875280 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:05:16.992352 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:17.087370 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Deleting instance files /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b_del Jan 26 19:05:17.087863 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Deletion of /opt/stack/data/nova/instances/f08a5384-6c6a-4ba6-b624-21dd5468299b_del complete Jan 26 19:05:17.175983 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:05:17.379192 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:05:17.597477 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Took 1.30 seconds to destroy the instance on the hypervisor. Jan 26 19:05:17.597785 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:05:17.598001 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:05:17.598158 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:05:17.598785 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:17.633148 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:05:17.633352 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:17.727420 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:17.884349 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:05:17.884613 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.724s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:17.884992 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.765s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:17.889953 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:05:17.890207 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Claim successful on node np0005596550.novalocal Jan 26 19:05:18.136008 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:05:18.639014 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Took 1.04 seconds to deallocate network for instance. Jan 26 19:05:18.884576 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:05:18.884793 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:05:18.885000 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:05:18.885160 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:05:18.894935 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:05:18.895025 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:05:19.105409 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:05:19.146743 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:19.611778 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:05:19.752823 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:20.117033 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.232s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:20.117376 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:05:20.119551 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.392s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:20.126239 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:05:20.126408 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Claim successful on node np0005596550.novalocal Jan 26 19:05:20.623693 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:05:20.623898 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:05:20.624170 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:20.627191 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:20.754015 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8369268788c24337ade1739d948c300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428b9d1e48c42f690612bf1e012ec42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:05:20.896278 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:05:21.130019 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:05:21.341094 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Successfully created port: 0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:05:21.392026 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:05:21.636762 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:05:21.740678 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Successfully updated port: 0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:05:21.769245 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-43db5fc8-7052-4955-bcba-1842d7cdc793 req-96825be2-12e2-4284-ae12-1df68badeb52 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received event network-changed-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:05:21.769638 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-43db5fc8-7052-4955-bcba-1842d7cdc793 req-96825be2-12e2-4284-ae12-1df68badeb52 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Refreshing instance network info cache due to event network-changed-0c5d371a-1c65-41be-864a-81be5995c568. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:05:21.769705 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-43db5fc8-7052-4955-bcba-1842d7cdc793 req-96825be2-12e2-4284-ae12-1df68badeb52 service nova] Acquiring lock "refresh_cache-c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:05:21.769906 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-43db5fc8-7052-4955-bcba-1842d7cdc793 req-96825be2-12e2-4284-ae12-1df68badeb52 service nova] Acquired lock "refresh_cache-c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:05:21.770108 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-43db5fc8-7052-4955-bcba-1842d7cdc793 req-96825be2-12e2-4284-ae12-1df68badeb52 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Refreshing network info cache for port 0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:05:21.895465 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:05:21.993810 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:22.244381 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "refresh_cache-c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:05:22.279108 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-43db5fc8-7052-4955-bcba-1842d7cdc793 req-96825be2-12e2-4284-ae12-1df68badeb52 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:22.324241 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-43db5fc8-7052-4955-bcba-1842d7cdc793 req-96825be2-12e2-4284-ae12-1df68badeb52 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:05:22.405091 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.285s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:22.405526 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:05:22.410333 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.264s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:22.468528 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-43db5fc8-7052-4955-bcba-1842d7cdc793 req-96825be2-12e2-4284-ae12-1df68badeb52 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:05:22.579662 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:05:22.652405 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:05:22.656883 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:05:22.657215 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Creating image(s) Jan 26 19:05:22.657815 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "/opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:22.658056 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "/opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:22.658709 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "/opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:22.659283 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:22.667858 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:22.671388 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:22.773280 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.102s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:22.774020 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:22.774067 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:22.774509 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:22.777366 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:22.777836 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:22.841255 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.063s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:22.841505 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:22.871442 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk 1073741824" returned: 0 in 0.029s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:22.872042 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.098s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:22.872568 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:22.918427 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:05:22.919154 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:05:22.920046 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:22.920426 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:22.955860 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.083s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:22.956213 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:05:22.956444 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:22.970240 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-43db5fc8-7052-4955-bcba-1842d7cdc793 req-96825be2-12e2-4284-ae12-1df68badeb52 service nova] Releasing lock "refresh_cache-c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:05:22.970793 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquired lock "refresh_cache-c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:05:22.971031 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:05:23.000300 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9bb266354284323ae54b4c3317c26e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55032abafa74d4facac03929da4a366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:05:23.031942 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:23.032289 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Cannot resize image /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:05:23.032620 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:05:23.032836 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Ensure instance console log exists: /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:05:23.033164 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:23.033372 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:23.033522 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:23.082911 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:05:23.455685 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:05:23.474881 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Successfully created port: e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48 {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:05:23.528398 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:05:23.589259 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.179s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:23.651691 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:23.672707 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Deleted allocations for instance f08a5384-6c6a-4ba6-b624-21dd5468299b Jan 26 19:05:23.762800 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Updating instance_info_cache with network_info: [{"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:05:23.871289 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Successfully updated port: e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48 {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:05:23.892428 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5261c0e9-33bd-4a1f-bf15-a902996cf6f8 req-16b5dbcb-caf9-480f-ae56-5887cb6f8006 service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Received event network-changed-e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:05:23.892578 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5261c0e9-33bd-4a1f-bf15-a902996cf6f8 req-16b5dbcb-caf9-480f-ae56-5887cb6f8006 service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Refreshing instance network info cache due to event network-changed-e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:05:23.892737 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5261c0e9-33bd-4a1f-bf15-a902996cf6f8 req-16b5dbcb-caf9-480f-ae56-5887cb6f8006 service nova] Acquiring lock "refresh_cache-e6131b49-ccfa-43e4-9480-76d9062c4e48" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:05:23.892856 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5261c0e9-33bd-4a1f-bf15-a902996cf6f8 req-16b5dbcb-caf9-480f-ae56-5887cb6f8006 service nova] Acquired lock "refresh_cache-e6131b49-ccfa-43e4-9480-76d9062c4e48" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:05:23.893012 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-5261c0e9-33bd-4a1f-bf15-a902996cf6f8 req-16b5dbcb-caf9-480f-ae56-5887cb6f8006 service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Refreshing network info cache for port e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:05:23.959119 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:05:24.218287 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:05:24.218427 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] VM Stopped (Lifecycle Event) Jan 26 19:05:24.266012 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Releasing lock "refresh_cache-c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:05:24.266374 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Instance network_info: |[{"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:05:24.269002 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Start _get_guest_xml network_info=[{"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:05:24.273706 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:05:24.276419 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1924433663', uuid='c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6'), owner=OwnerMeta(userid='8369268788c24337ade1739d948c300a', username='tempest-ServerActionsTestOtherB-1262198412-project-member', projectid='8428b9d1e48c42f690612bf1e012ec42', projectname='tempest-ServerActionsTestOtherB-1262198412'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472324.2755017) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:05:24.278942 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:05:24.279548 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:05:24.281509 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:05:24.282390 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:05:24.284197 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:05:24.285109 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:05:24.285555 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:05:24.285892 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:05:24.286295 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:05:24.286678 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:05:24.287132 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:05:24.287657 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:05:24.288100 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:05:24.288541 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:05:24.289010 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:05:24.289470 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:05:24.296970 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:05:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1924433663',display_name='tempest-ServerActionsTestOtherB-server-1924433663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-1924433663',id=68,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK72/fZgFXc8Nm23qFp5bqxu5uQWjdqvi6tf0S8eHH5LAOejrjAG2pg3k7mvst6GtMR5cAEv++XPpoBWMRpc6kXyw3lb+Uukjxykolyr/SPF2WcEU8zRsEYayUYxi/WyQ==',key_name='tempest-keypair-56259378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-i9xjjhbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:05:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:05:24.297355 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:05:24.298537 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:de:3a,bridge_name='br-int',has_traffic_filtering=True,id=0c5d371a-1c65-41be-864a-81be5995c568,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5d371a-1c') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:05:24.299713 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'pci_devices' on Instance uuid c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:05:24.373500 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "refresh_cache-e6131b49-ccfa-43e4-9480-76d9062c4e48" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:05:24.395837 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-5261c0e9-33bd-4a1f-bf15-a902996cf6f8 req-16b5dbcb-caf9-480f-ae56-5887cb6f8006 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:24.461753 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-5261c0e9-33bd-4a1f-bf15-a902996cf6f8 req-16b5dbcb-caf9-480f-ae56-5887cb6f8006 service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:05:24.622697 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-5261c0e9-33bd-4a1f-bf15-a902996cf6f8 req-16b5dbcb-caf9-480f-ae56-5887cb6f8006 service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:05:24.686564 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-67c318f4-983c-45f6-8b4b-fd37e0b56a5f tempest-ServersListShow2100Test-1350606506 tempest-ServersListShow2100Test-1350606506-project-member] Lock "f08a5384-6c6a-4ba6-b624-21dd5468299b" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 10.051s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:24.722445 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-d11a7b13-e079-49c5-b85d-a5e4bcee50a8 None None] [instance: ca9a34ab-50c7-4278-b247-c7a7baeb5968] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:24.754234 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] End _get_guest_xml xml= Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6 Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: instance-00000044 Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-server-1924433663 Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:05:24 Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-1262198412-project-member Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-1262198412 Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6 Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6 Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:24.804752 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:05:24.806603 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Preparing to wait for external event network-vif-plugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:05:24.806603 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:24.806603 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:24.806603 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:24.806693 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:05:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1924433663',display_name='tempest-ServerActionsTestOtherB-server-1924433663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-1924433663',id=68,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK72/fZgFXc8Nm23qFp5bqxu5uQWjdqvi6tf0S8eHH5LAOejrjAG2pg3k7mvst6GtMR5cAEv++XPpoBWMRpc6kXyw3lb+Uukjxykolyr/SPF2WcEU8zRsEYayUYxi/WyQ==',key_name='tempest-keypair-56259378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-i9xjjhbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:05:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:05:24.806966 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:05:24.807616 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:de:3a,bridge_name='br-int',has_traffic_filtering=True,id=0c5d371a-1c65-41be-864a-81be5995c568,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5d371a-1c') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:05:24.808003 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:de:3a,bridge_name='br-int',has_traffic_filtering=True,id=0c5d371a-1c65-41be-864a-81be5995c568,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5d371a-1c') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:05:24.808414 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:24.808819 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:24.809250 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:05:24.810118 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:24.810362 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea2c2523-d2d3-5ad2-ad14-3c5335468bcc', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:24.811244 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:24.813318 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:05:24.813965 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:24.816396 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:24.816635 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c5d371a-1c, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:24.817168 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c5d371a-1c, col_values=(('qos', UUID('9876ee3c-6bc9-44de-bf4b-f4b622b5f15a')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:24.817417 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c5d371a-1c, col_values=(('external_ids', {'iface-id': '0c5d371a-1c65-41be-864a-81be5995c568', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:de:3a', 'vm-uuid': 'c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:24.818384 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:24.823478 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:05:24.826926 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:24.828460 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:de:3a,bridge_name='br-int',has_traffic_filtering=True,id=0c5d371a-1c65-41be-864a-81be5995c568,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5d371a-1c') Jan 26 19:05:24.979959 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:05:24.984680 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:05:24.985291 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Creating image(s) Jan 26 19:05:24.986077 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6131b49-ccfa-43e4-9480-76d9062c4e48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:24.986506 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "/opt/stack/data/nova/instances/e6131b49-ccfa-43e4-9480-76d9062c4e48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:24.988667 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "/opt/stack/data/nova/instances/e6131b49-ccfa-43e4-9480-76d9062c4e48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:24.989308 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:24.995787 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:24.997293 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:25.093288 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.096s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:25.093654 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:25.094077 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:25.094465 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:25.097578 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:25.097969 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:25.127005 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5261c0e9-33bd-4a1f-bf15-a902996cf6f8 req-16b5dbcb-caf9-480f-ae56-5887cb6f8006 service nova] Releasing lock "refresh_cache-e6131b49-ccfa-43e4-9480-76d9062c4e48" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:05:25.127482 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquired lock "refresh_cache-e6131b49-ccfa-43e4-9480-76d9062c4e48" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:05:25.127636 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:05:25.169319 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.071s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:25.169841 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/e6131b49-ccfa-43e4-9480-76d9062c4e48/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:25.204222 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/e6131b49-ccfa-43e4-9480-76d9062c4e48/disk 1073741824" returned: 0 in 0.034s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:25.204876 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.111s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:25.205396 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:25.289792 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.083s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:25.289792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6131b49-ccfa-43e4-9480-76d9062c4e48/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:05:25.290216 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6131b49-ccfa-43e4-9480-76d9062c4e48/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:25.383204 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6131b49-ccfa-43e4-9480-76d9062c4e48/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:25.383490 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Cannot resize image /opt/stack/data/nova/instances/e6131b49-ccfa-43e4-9480-76d9062c4e48/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:05:25.383792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:05:25.383982 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Ensure instance console log exists: /opt/stack/data/nova/instances/e6131b49-ccfa-43e4-9480-76d9062c4e48/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:05:25.384272 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:25.384491 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:25.384639 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:25.695853 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:05:25.821370 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:25.901990 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Updating instance_info_cache with network_info: [{"id": "e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48", "address": "fa:16:3e:9b:37:0d", "network": {"id": "e3c16b95-f7e4-4902-8796-2e826827292b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093833914-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c55032abafa74d4facac03929da4a366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b3b0ae-bb", "ovs_interfaceid": "e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:05:26.350449 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:05:26.350916 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:05:26.350916 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No VIF found with MAC fa:16:3e:5b:de:3a, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:05:26.351446 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Using config drive Jan 26 19:05:26.404684 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Releasing lock "refresh_cache-e6131b49-ccfa-43e4-9480-76d9062c4e48" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:05:26.405027 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Instance network_info: |[{"id": "e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48", "address": "fa:16:3e:9b:37:0d", "network": {"id": "e3c16b95-f7e4-4902-8796-2e826827292b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093833914-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c55032abafa74d4facac03929da4a366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b3b0ae-bb", "ovs_interfaceid": "e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:05:26.406724 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Start _get_guest_xml network_info=[{"id": "e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48", "address": "fa:16:3e:9b:37:0d", "network": {"id": "e3c16b95-f7e4-4902-8796-2e826827292b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093833914-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c55032abafa74d4facac03929da4a366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b3b0ae-bb", "ovs_interfaceid": "e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:05:26.410183 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:05:26.411373 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-570532072', uuid='e6131b49-ccfa-43e4-9480-76d9062c4e48'), owner=OwnerMeta(userid='d9bb266354284323ae54b4c3317c26e5', username='tempest-VolumesSnapshotTestJSON-666453103-project-member', projectid='c55032abafa74d4facac03929da4a366', projectname='tempest-VolumesSnapshotTestJSON-666453103'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48", "address": "fa:16:3e:9b:37:0d", "network": {"id": "e3c16b95-f7e4-4902-8796-2e826827292b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093833914-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c55032abafa74d4facac03929da4a366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b3b0ae-bb", "ovs_interfaceid": "e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472326.411016) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:05:26.412983 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:05:26.413325 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:05:26.414727 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:05:26.415003 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:05:26.415795 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:05:26.416082 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:05:26.416242 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:05:26.416410 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:05:26.416567 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:05:26.416687 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:05:26.416821 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:05:26.416995 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:05:26.417132 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:05:26.417316 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:05:26.417487 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:05:26.417632 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:05:26.420507 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-570532072',display_name='tempest-VolumesSnapshotTestJSON-instance-570532072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-volumessnapshottestjson-instance-570532072',id=69,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEptXtRwQl+m7IMu+lc3XKgLkXexCd6eGnQ/2x/e3xllggtnNpbNn8xpwY5xeXdRzW7i0X3Ur4XAGdvln6LGUhfvxFRkGOi399SUYq9B3Fnvra7dptnaJGGNFSeM12Za+w==',key_name='tempest-keypair-16327304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c55032abafa74d4facac03929da4a366',ramdisk_id='',reservation_id='r-o8zz3v6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-666453103',owner_user_name='tempest-VolumesSnapshotTestJSON-666453103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:05:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9bb266354284323ae54b4c3317c26e5',uuid=e6131b49-ccfa-43e4-9480-76d9062c4e48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48", "address": "fa:16:3e:9b:37:0d", "network": {"id": "e3c16b95-f7e4-4902-8796-2e826827292b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093833914-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c55032abafa74d4facac03929da4a366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b3b0ae-bb", "ovs_interfaceid": "e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:05:26.420712 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Converting VIF {"id": "e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48", "address": "fa:16:3e:9b:37:0d", "network": {"id": "e3c16b95-f7e4-4902-8796-2e826827292b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093833914-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c55032abafa74d4facac03929da4a366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b3b0ae-bb", "ovs_interfaceid": "e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:05:26.421239 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:37:0d,bridge_name='br-int',has_traffic_filtering=True,id=e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48,network=Network(e3c16b95-f7e4-4902-8796-2e826827292b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b3b0ae-bb') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:05:26.421698 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lazy-loading 'pci_devices' on Instance uuid e6131b49-ccfa-43e4-9480-76d9062c4e48 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:05:26.771198 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Acquiring lock "030a77eb-256b-407c-8ebd-6a578a41570e" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:26.771433 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "030a77eb-256b-407c-8ebd-6a578a41570e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:26.857561 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] End _get_guest_xml xml= Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: e6131b49-ccfa-43e4-9480-76d9062c4e48 Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: instance-00000045 Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: tempest-VolumesSnapshotTestJSON-instance-570532072 Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:05:26 Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: tempest-VolumesSnapshotTestJSON-666453103-project-member Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: tempest-VolumesSnapshotTestJSON-666453103 Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: e6131b49-ccfa-43e4-9480-76d9062c4e48 Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: e6131b49-ccfa-43e4-9480-76d9062c4e48 Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:26.925075 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:05:26.926964 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Preparing to wait for external event network-vif-plugged-e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48 {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:05:26.926964 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "e6131b49-ccfa-43e4-9480-76d9062c4e48-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:26.926964 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "e6131b49-ccfa-43e4-9480-76d9062c4e48-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:26.926964 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "e6131b49-ccfa-43e4-9480-76d9062c4e48-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:26.927355 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-570532072',display_name='tempest-VolumesSnapshotTestJSON-instance-570532072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-volumessnapshottestjson-instance-570532072',id=69,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEptXtRwQl+m7IMu+lc3XKgLkXexCd6eGnQ/2x/e3xllggtnNpbNn8xpwY5xeXdRzW7i0X3Ur4XAGdvln6LGUhfvxFRkGOi399SUYq9B3Fnvra7dptnaJGGNFSeM12Za+w==',key_name='tempest-keypair-16327304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c55032abafa74d4facac03929da4a366',ramdisk_id='',reservation_id='r-o8zz3v6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-666453103',owner_user_name='tempest-VolumesSnapshotTestJSON-666453103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:05:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9bb266354284323ae54b4c3317c26e5',uuid=e6131b49-ccfa-43e4-9480-76d9062c4e48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48", "address": "fa:16:3e:9b:37:0d", "network": {"id": "e3c16b95-f7e4-4902-8796-2e826827292b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093833914-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c55032abafa74d4facac03929da4a366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b3b0ae-bb", "ovs_interfaceid": "e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:05:26.927692 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Converting VIF {"id": "e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48", "address": "fa:16:3e:9b:37:0d", "network": {"id": "e3c16b95-f7e4-4902-8796-2e826827292b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093833914-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c55032abafa74d4facac03929da4a366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b3b0ae-bb", "ovs_interfaceid": "e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:05:26.928427 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:37:0d,bridge_name='br-int',has_traffic_filtering=True,id=e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48,network=Network(e3c16b95-f7e4-4902-8796-2e826827292b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b3b0ae-bb') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:05:26.931384 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:37:0d,bridge_name='br-int',has_traffic_filtering=True,id=e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48,network=Network(e3c16b95-f7e4-4902-8796-2e826827292b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b3b0ae-bb') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:05:26.931384 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:26.931384 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:26.931384 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:05:26.931384 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:26.931575 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7473593-4acb-59a4-8698-9128ce5e14c0', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:26.932471 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:26.934933 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:05:26.939469 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:26.942103 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:26.942284 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4b3b0ae-bb, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:26.942575 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4b3b0ae-bb, col_values=(('qos', UUID('0155fddc-9e41-4a4e-b7e6-7245c044bd08')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:26.942738 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4b3b0ae-bb, col_values=(('external_ids', {'iface-id': 'e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:37:0d', 'vm-uuid': 'e6131b49-ccfa-43e4-9480-76d9062c4e48'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:26.946704 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Creating config drive at /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk.config Jan 26 19:05:26.950618 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpkn79yjjf {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:26.958091 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:26.961498 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:05:26.962397 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:37:0d,bridge_name='br-int',has_traffic_filtering=True,id=e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48,network=Network(e3c16b95-f7e4-4902-8796-2e826827292b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b3b0ae-bb') Jan 26 19:05:26.994647 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:27.074785 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpkn79yjjf" returned: 0 in 0.124s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:27.141307 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:27.158028 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:27.261582 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:27.267184 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:27.274103 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:05:27.314393 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:05:27.314538 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] VM Started (Lifecycle Event) Jan 26 19:05:27.376383 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-335558e7-c25d-42c1-a3b1-66626a099f85 req-8cc4d925-372f-427b-a002-3713238662fa service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received event network-vif-plugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:05:27.376737 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-335558e7-c25d-42c1-a3b1-66626a099f85 req-8cc4d925-372f-427b-a002-3713238662fa service nova] Acquiring lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:27.376902 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-335558e7-c25d-42c1-a3b1-66626a099f85 req-8cc4d925-372f-427b-a002-3713238662fa service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:27.377042 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-335558e7-c25d-42c1-a3b1-66626a099f85 req-8cc4d925-372f-427b-a002-3713238662fa service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:27.377173 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-335558e7-c25d-42c1-a3b1-66626a099f85 req-8cc4d925-372f-427b-a002-3713238662fa service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Processing event network-vif-plugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:05:27.377680 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:05:27.383592 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:05:27.389577 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Instance spawned successfully. Jan 26 19:05:27.389833 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:05:27.815604 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:27.815880 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:27.817704 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:27.821446 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:05:27.821654 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Claim successful on node np0005596550.novalocal Jan 26 19:05:27.826569 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:05:27.897602 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:27.897731 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:27.898216 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:27.898558 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:27.898974 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:27.899340 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:28.328859 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:05:28.329084 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:05:28.329264 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] VM Paused (Lifecycle Event) Jan 26 19:05:28.404581 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Took 5.75 seconds to spawn the instance on the hypervisor. Jan 26 19:05:28.405084 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:28.489614 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:05:28.489807 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:05:28.489979 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] No VIF found with MAC fa:16:3e:9b:37:0d, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:05:28.490489 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Using config drive Jan 26 19:05:28.858877 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:28.863673 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:05:28.863673 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] VM Resumed (Lifecycle Event) Jan 26 19:05:28.921440 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Took 12.84 seconds to build instance. Jan 26 19:05:28.997571 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:29.094161 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:05:29.136680 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Creating config drive at /opt/stack/data/nova/instances/e6131b49-ccfa-43e4-9480-76d9062c4e48/disk.config Jan 26 19:05:29.140070 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/e6131b49-ccfa-43e4-9480-76d9062c4e48/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpyubidegh {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:29.258884 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/e6131b49-ccfa-43e4-9480-76d9062c4e48/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpyubidegh" returned: 0 in 0.118s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:29.368670 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:29.368670 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:29.368670 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:29.374962 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:29.387350 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:05:29.426172 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e97569aa-5ee3-41b0-825c-a4b37bd87f52 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.354s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:29.427255 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d4c5109b-7d75-48b0-ab60-2448f250b362 req-6d6d51d5-a75b-4acd-9707-d8c17fdeed2d service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received event network-vif-plugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:05:29.427423 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d4c5109b-7d75-48b0-ab60-2448f250b362 req-6d6d51d5-a75b-4acd-9707-d8c17fdeed2d service nova] Acquiring lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:29.427590 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d4c5109b-7d75-48b0-ab60-2448f250b362 req-6d6d51d5-a75b-4acd-9707-d8c17fdeed2d service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:29.427721 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d4c5109b-7d75-48b0-ab60-2448f250b362 req-6d6d51d5-a75b-4acd-9707-d8c17fdeed2d service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:29.428037 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d4c5109b-7d75-48b0-ab60-2448f250b362 req-6d6d51d5-a75b-4acd-9707-d8c17fdeed2d service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] No waiting events found dispatching network-vif-plugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:05:29.428114 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-d4c5109b-7d75-48b0-ab60-2448f250b362 req-6d6d51d5-a75b-4acd-9707-d8c17fdeed2d service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received unexpected event network-vif-plugged-0c5d371a-1c65-41be-864a-81be5995c568 for instance with vm_state active and task_state None. Jan 26 19:05:29.549745 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7e53ca7a-4989-45e0-880b-1aa1359c0fae req-b23bdca0-8e74-468d-b8d8-c8a43ab2d20f service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Received event network-vif-plugged-e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:05:29.549990 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7e53ca7a-4989-45e0-880b-1aa1359c0fae req-b23bdca0-8e74-468d-b8d8-c8a43ab2d20f service nova] Acquiring lock "e6131b49-ccfa-43e4-9480-76d9062c4e48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:29.550304 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7e53ca7a-4989-45e0-880b-1aa1359c0fae req-b23bdca0-8e74-468d-b8d8-c8a43ab2d20f service nova] Lock "e6131b49-ccfa-43e4-9480-76d9062c4e48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:29.550449 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7e53ca7a-4989-45e0-880b-1aa1359c0fae req-b23bdca0-8e74-468d-b8d8-c8a43ab2d20f service nova] Lock "e6131b49-ccfa-43e4-9480-76d9062c4e48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:29.550648 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7e53ca7a-4989-45e0-880b-1aa1359c0fae req-b23bdca0-8e74-468d-b8d8-c8a43ab2d20f service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Processing event network-vif-plugged-e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48 {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:05:29.569574 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:05:29.577213 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:05:29.585612 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Instance spawned successfully. Jan 26 19:05:29.585612 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:05:29.600911 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:05:29.658515 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:29.662226 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:29.665043 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:29.667659 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:29.671735 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:29.892943 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:05:29.893994 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] VM Started (Lifecycle Event) Jan 26 19:05:30.098493 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:30.098655 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:30.099008 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:30.099285 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:30.099603 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:30.099915 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:30.108713 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.293s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:30.109666 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:05:30.398031 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:30.400959 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:05:30.605042 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Took 5.62 seconds to spawn the instance on the hypervisor. Jan 26 19:05:30.605830 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:30.615817 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Not allocating networking since 'none' was specified. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2039}} Jan 26 19:05:30.904230 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:05:30.904423 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:05:30.904578 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] VM Paused (Lifecycle Event) Jan 26 19:05:31.116419 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Took 13.43 seconds to build instance. Jan 26 19:05:31.118680 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:05:31.407166 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:31.448125 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:05:31.448559 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] VM Resumed (Lifecycle Event) Jan 26 19:05:31.576448 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:05:31.576568 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] VM Stopped (Lifecycle Event) Jan 26 19:05:31.593853 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ee57f13f-7f06-44d3-aab4-69569bc9732e req-132d5590-3bfb-4d2b-ad11-b9a43969e4ae service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Received event network-vif-plugged-e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:05:31.593992 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ee57f13f-7f06-44d3-aab4-69569bc9732e req-132d5590-3bfb-4d2b-ad11-b9a43969e4ae service nova] Acquiring lock "e6131b49-ccfa-43e4-9480-76d9062c4e48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:31.594173 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ee57f13f-7f06-44d3-aab4-69569bc9732e req-132d5590-3bfb-4d2b-ad11-b9a43969e4ae service nova] Lock "e6131b49-ccfa-43e4-9480-76d9062c4e48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:31.594382 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ee57f13f-7f06-44d3-aab4-69569bc9732e req-132d5590-3bfb-4d2b-ad11-b9a43969e4ae service nova] Lock "e6131b49-ccfa-43e4-9480-76d9062c4e48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:31.594574 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ee57f13f-7f06-44d3-aab4-69569bc9732e req-132d5590-3bfb-4d2b-ad11-b9a43969e4ae service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] No waiting events found dispatching network-vif-plugged-e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:05:31.594777 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-ee57f13f-7f06-44d3-aab4-69569bc9732e req-132d5590-3bfb-4d2b-ad11-b9a43969e4ae service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Received unexpected event network-vif-plugged-e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48 for instance with vm_state active and task_state None. Jan 26 19:05:31.594975 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ee57f13f-7f06-44d3-aab4-69569bc9732e req-132d5590-3bfb-4d2b-ad11-b9a43969e4ae service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received event network-changed-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:05:31.595171 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ee57f13f-7f06-44d3-aab4-69569bc9732e req-132d5590-3bfb-4d2b-ad11-b9a43969e4ae service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Refreshing instance network info cache due to event network-changed-0c5d371a-1c65-41be-864a-81be5995c568. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:05:31.595437 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ee57f13f-7f06-44d3-aab4-69569bc9732e req-132d5590-3bfb-4d2b-ad11-b9a43969e4ae service nova] Acquiring lock "refresh_cache-c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:05:31.595600 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ee57f13f-7f06-44d3-aab4-69569bc9732e req-132d5590-3bfb-4d2b-ad11-b9a43969e4ae service nova] Acquired lock "refresh_cache-c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:05:31.596199 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-ee57f13f-7f06-44d3-aab4-69569bc9732e req-132d5590-3bfb-4d2b-ad11-b9a43969e4ae service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Refreshing network info cache for port 0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:05:31.619208 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-56806b6f-8f68-4e73-aeb0-f02a3e51a48c req-519998cc-7b61-428a-9b64-773a6eff8e03 service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Received event network-changed-e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:05:31.619640 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-56806b6f-8f68-4e73-aeb0-f02a3e51a48c req-519998cc-7b61-428a-9b64-773a6eff8e03 service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Refreshing instance network info cache due to event network-changed-e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:05:31.619640 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-56806b6f-8f68-4e73-aeb0-f02a3e51a48c req-519998cc-7b61-428a-9b64-773a6eff8e03 service nova] Acquiring lock "refresh_cache-e6131b49-ccfa-43e4-9480-76d9062c4e48" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:05:31.619869 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-56806b6f-8f68-4e73-aeb0-f02a3e51a48c req-519998cc-7b61-428a-9b64-773a6eff8e03 service nova] Acquired lock "refresh_cache-e6131b49-ccfa-43e4-9480-76d9062c4e48" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:05:31.620405 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-56806b6f-8f68-4e73-aeb0-f02a3e51a48c req-519998cc-7b61-428a-9b64-773a6eff8e03 service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Refreshing network info cache for port e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:05:31.627034 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-879dede4-2097-473a-9455-008ec72acad4 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "e6131b49-ccfa-43e4-9480-76d9062c4e48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.953s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:31.627476 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:05:31.946490 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:31.952485 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:31.954486 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:05:31.996164 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:32.080607 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-1bbf54de-faa0-4215-beba-e4767c65ce1d None None] [instance: f08a5384-6c6a-4ba6-b624-21dd5468299b] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:32.102320 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-ee57f13f-7f06-44d3-aab4-69569bc9732e req-132d5590-3bfb-4d2b-ad11-b9a43969e4ae service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:32.126199 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-56806b6f-8f68-4e73-aeb0-f02a3e51a48c req-519998cc-7b61-428a-9b64-773a6eff8e03 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:32.408624 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-56806b6f-8f68-4e73-aeb0-f02a3e51a48c req-519998cc-7b61-428a-9b64-773a6eff8e03 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:32.422784 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-ee57f13f-7f06-44d3-aab4-69569bc9732e req-132d5590-3bfb-4d2b-ad11-b9a43969e4ae service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:32.507299 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-56806b6f-8f68-4e73-aeb0-f02a3e51a48c req-519998cc-7b61-428a-9b64-773a6eff8e03 service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Updated VIF entry in instance network info cache for port e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:05:32.507619 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-56806b6f-8f68-4e73-aeb0-f02a3e51a48c req-519998cc-7b61-428a-9b64-773a6eff8e03 service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Updating instance_info_cache with network_info: [{"id": "e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48", "address": "fa:16:3e:9b:37:0d", "network": {"id": "e3c16b95-f7e4-4902-8796-2e826827292b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093833914-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c55032abafa74d4facac03929da4a366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b3b0ae-bb", "ovs_interfaceid": "e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:05:32.514196 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-ee57f13f-7f06-44d3-aab4-69569bc9732e req-132d5590-3bfb-4d2b-ad11-b9a43969e4ae service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Updated VIF entry in instance network info cache for port 0c5d371a-1c65-41be-864a-81be5995c568. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:05:32.514561 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-ee57f13f-7f06-44d3-aab4-69569bc9732e req-132d5590-3bfb-4d2b-ad11-b9a43969e4ae service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Updating instance_info_cache with network_info: [{"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:05:32.661142 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:05:32.662183 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:05:32.662496 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Creating image(s) Jan 26 19:05:32.663048 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Acquiring lock "/opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:32.663263 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "/opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:32.663873 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "/opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:32.664454 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:32.668244 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:32.669954 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:32.781843 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.111s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:32.782263 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:32.782709 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:32.783191 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:32.787187 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:32.787803 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:32.883580 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.096s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:32.883984 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:32.919826 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk 1073741824" returned: 0 in 0.035s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:32.919826 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.137s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:32.919826 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:33.011178 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-56806b6f-8f68-4e73-aeb0-f02a3e51a48c req-519998cc-7b61-428a-9b64-773a6eff8e03 service nova] Releasing lock "refresh_cache-e6131b49-ccfa-43e4-9480-76d9062c4e48" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:05:33.017181 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ee57f13f-7f06-44d3-aab4-69569bc9732e req-132d5590-3bfb-4d2b-ad11-b9a43969e4ae service nova] Releasing lock "refresh_cache-c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:05:33.024823 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.105s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:33.025113 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Checking if we can resize image /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:05:33.025343 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:33.089654 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk --force-share --output=json" returned: 0 in 0.064s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:33.090016 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Cannot resize image /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:05:33.090384 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:05:33.090606 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Ensure instance console log exists: /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:05:33.091008 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:33.091267 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:33.091475 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:33.092714 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Start _get_guest_xml network_info=[] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:05:33.096099 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:05:33.097363 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServersListShow296Test-server-313643347', uuid='030a77eb-256b-407c-8ebd-6a578a41570e'), owner=OwnerMeta(userid='10455ac34c4147048c443192a34d02d5', username='tempest-ServersListShow296Test-1010639838-project-member', projectid='be751157281b4a15a43aac0d38fe75e1', projectname='tempest-ServersListShow296Test-1010639838'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[], nova_package='32.1.0', creation_time=1769472333.0969157) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:05:33.098495 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:05:33.098843 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:05:33.100162 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:05:33.100493 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:05:33.101270 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:05:33.101566 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:05:33.101737 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:05:33.101927 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:05:33.102081 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:05:33.102199 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:05:33.102319 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:05:33.102492 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:05:33.102620 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:05:33.102755 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:05:33.102899 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:05:33.103036 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:05:33.106093 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lazy-loading 'pci_devices' on Instance uuid 030a77eb-256b-407c-8ebd-6a578a41570e {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] End _get_guest_xml xml= Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: 030a77eb-256b-407c-8ebd-6a578a41570e Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: instance-00000046 Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: tempest-ServersListShow296Test-server-313643347 Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:05:33 Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: tempest-ServersListShow296Test-1010639838-project-member Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: tempest-ServersListShow296Test-1010639838 Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: 030a77eb-256b-407c-8ebd-6a578a41570e Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: 030a77eb-256b-407c-8ebd-6a578a41570e Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:33.611188 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:05:35.134116 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:05:35.134464 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:05:35.135272 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Using config drive Jan 26 19:05:35.648346 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:35.704248 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Creating config drive at /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk.config Jan 26 19:05:35.708341 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp154vz1f9 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:35.827966 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp154vz1f9" returned: 0 in 0.119s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:36.079306 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:05:36.079554 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] VM Resumed (Lifecycle Event) Jan 26 19:05:36.083806 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Instance event wait completed in 0 seconds for {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:05:36.084112 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:05:36.089975 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Instance spawned successfully. Jan 26 19:05:36.089975 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:05:36.587248 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:36.591125 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:05:36.602710 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:36.603458 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:36.604355 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:36.605267 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:36.605557 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:36.606202 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:36.949043 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:36.997310 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:37.096596 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:05:37.096757 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:05:37.096929 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] VM Started (Lifecycle Event) Jan 26 19:05:37.113653 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Took 4.45 seconds to spawn the instance on the hypervisor. Jan 26 19:05:37.113825 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:37.600448 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:37.607462 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:05:37.627070 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Took 9.85 seconds to build instance. Jan 26 19:05:38.131793 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b03aa573-cd73-4a6e-8486-c0dd7833851a tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "030a77eb-256b-407c-8ebd-6a578a41570e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 11.360s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:39.397897 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Rebuilding instance Jan 26 19:05:39.499475 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:39.812494 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Stashing vm_state: active {{(pid=189076) _prep_resize /opt/stack/nova/nova/compute/manager.py:6217}} Jan 26 19:05:40.361373 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:40.361584 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:40.746384 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Instance destroyed successfully. Jan 26 19:05:40.757059 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Instance destroyed successfully. Jan 26 19:05:40.757059 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Deleting instance files /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e_del Jan 26 19:05:40.757059 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Deletion of /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e_del complete Jan 26 19:05:40.870562 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:05:40.870984 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Claim successful on node np0005596550.novalocal Jan 26 19:05:41.382812 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.resource_tracker [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Updating resource usage from migration cfca8fbb-dda4-4575-938e-2c7ccf441948 Jan 26 19:05:41.654294 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:05:41.953061 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:42.000448 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:42.156808 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:05:42.278894 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:05:42.278894 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Creating image(s) Jan 26 19:05:42.279124 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Acquiring lock "/opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:42.279462 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "/opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:42.280190 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "/opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:42.280801 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:42.285127 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:42.287886 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:42.362959 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json" returned: 0 in 0.075s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:42.363351 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Acquiring lock "791283f4306f6266c365d052f132d740f0c9b85f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:42.363809 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "791283f4306f6266c365d052f132d740f0c9b85f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:42.365870 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:42.367290 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:05:42.367645 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:42.432278 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json" returned: 0 in 0.064s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:42.432876 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f,backing_fmt=raw /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:42.464708 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f,backing_fmt=raw /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk 1073741824" returned: 0 in 0.031s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:42.465319 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "791283f4306f6266c365d052f132d740f0c9b85f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.102s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:42.465721 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:42.538769 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json" returned: 0 in 0.073s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:42.539417 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Checking if we can resize image /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:05:42.539734 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:42.607162 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk --force-share --output=json" returned: 0 in 0.067s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:42.607834 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Cannot resize image /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:05:42.608381 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:05:42.608707 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Ensure instance console log exists: /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:05:42.609219 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:42.609591 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:42.609951 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:42.611944 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Start _get_guest_xml network_info=[] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-01-26T23:49:28Z,direct_url=,disk_format='qcow2',id=bd70f82e-84e0-4042-ad07-7b834bb8ac38,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-01-26T23:49:31Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:05:42.615926 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError Jan 26 19:05:42.617465 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bd70f82e-84e0-4042-ad07-7b834bb8ac38', instance_meta=NovaInstanceMeta(name='tempest-ServersListShow296Test-server-313643347', uuid='030a77eb-256b-407c-8ebd-6a578a41570e'), owner=OwnerMeta(userid='10455ac34c4147048c443192a34d02d5', username='tempest-ServersListShow296Test-1010639838-project-member', projectid='be751157281b4a15a43aac0d38fe75e1', projectname='tempest-ServersListShow296Test-1010639838'), image=ImageMeta(id='bd70f82e-84e0-4042-ad07-7b834bb8ac38', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[], nova_package='32.1.0', creation_time=1769472342.6170635) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:05:42.619344 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:05:42.619909 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:05:42.621140 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:05:42.621640 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:05:42.623154 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:05:42.623947 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-01-26T23:49:28Z,direct_url=,disk_format='qcow2',id=bd70f82e-84e0-4042-ad07-7b834bb8ac38,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-01-26T23:49:31Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:05:42.624316 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:05:42.624577 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:05:42.624902 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:05:42.625228 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:05:42.625523 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:05:42.626021 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:05:42.626291 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:05:42.626566 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:05:42.626890 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:05:42.627183 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:05:42.627494 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lazy-loading 'vcpu_model' on Instance uuid 030a77eb-256b-407c-8ebd-6a578a41570e {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:05:42.664889 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.301s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:42.664889 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Migrating Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] End _get_guest_xml xml= Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: 030a77eb-256b-407c-8ebd-6a578a41570e Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: instance-00000046 Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: tempest-ServersListShow296Test-server-313643347 Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:05:42 Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: tempest-ServersListShow296Test-1010639838-project-member Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: tempest-ServersListShow296Test-1010639838 Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: 030a77eb-256b-407c-8ebd-6a578a41570e Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: 030a77eb-256b-407c-8ebd-6a578a41570e Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:43.135945 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:05:43.180874 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "refresh_cache-48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:05:43.180874 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquired lock "refresh_cache-48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:05:43.180874 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:05:43.685813 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:43.925979 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:44.061800 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Updating instance_info_cache with network_info: [{"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:05:44.566038 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Releasing lock "refresh_cache-48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:05:44.658849 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:05:44.658849 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:05:44.659989 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Using config drive Jan 26 19:05:45.164300 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lazy-loading 'ec2_ids' on Instance uuid 030a77eb-256b-407c-8ebd-6a578a41570e {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:05:45.670117 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Object Instance<030a77eb-256b-407c-8ebd-6a578a41570e> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:05:45.670117 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lazy-loading 'keypairs' on Instance uuid 030a77eb-256b-407c-8ebd-6a578a41570e {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:05:46.085318 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Starting migrate_disk_and_power_off {{(pid=189076) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12481}} Jan 26 19:05:46.174885 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Object Instance<030a77eb-256b-407c-8ebd-6a578a41570e> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:05:46.175840 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError Jan 26 19:05:46.197706 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:46.205032 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:46.237403 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:46.242789 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Creating config drive at /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk.config Jan 26 19:05:46.246915 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp5_aadrfb {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:46.256293 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:46.360869 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6d332052-0cda-477d-b870-a851d72ae69e req-e998b17a-57fb-4d94-b6cc-ae0c9b4bcfb5 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received event network-vif-unplugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:05:46.361119 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6d332052-0cda-477d-b870-a851d72ae69e req-e998b17a-57fb-4d94-b6cc-ae0c9b4bcfb5 service nova] Acquiring lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:46.361252 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6d332052-0cda-477d-b870-a851d72ae69e req-e998b17a-57fb-4d94-b6cc-ae0c9b4bcfb5 service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:46.361396 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6d332052-0cda-477d-b870-a851d72ae69e req-e998b17a-57fb-4d94-b6cc-ae0c9b4bcfb5 service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:46.361538 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6d332052-0cda-477d-b870-a851d72ae69e req-e998b17a-57fb-4d94-b6cc-ae0c9b4bcfb5 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] No waiting events found dispatching network-vif-unplugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:05:46.361685 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-6d332052-0cda-477d-b870-a851d72ae69e req-e998b17a-57fb-4d94-b6cc-ae0c9b4bcfb5 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received unexpected event network-vif-unplugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 for instance with vm_state active and task_state resize_migrating. Jan 26 19:05:46.366002 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Instance destroyed successfully. Jan 26 19:05:46.366813 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-469643394',display_name='tempest-ServerActionsTestJSON-server-469643394',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestjson-server-469643394',id=67,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaqJcAWtBvnDQt3Z0Zs2SEk8GmS4qswJn8I3pLNnZ26AiUp6izAb2VATu7Ta6RkUjooYd/ncwVnO6h5/K851Ht4DSyJ8eVOthZpoT3zQfgSsI2MjV6hMkI8XyrAdvV6PQ==',key_name='tempest-keypair-571396453',keypairs=,launch_index=0,launched_at=2026-01-27T00:05:11Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-v7nt6kx2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:05:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=48ff5e37-56fe-46a8-b14c-8e4cf3197fb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1812167825-network", "vif_mac": "fa:16:3e:9b:fd:69"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:05:46.366998 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1812167825-network", "vif_mac": "fa:16:3e:9b:fd:69"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:05:46.367548 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:fd:69,bridge_name='br-int',has_traffic_filtering=True,id=fe2a5eb1-3745-4099-b530-b2e55ec11296,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2a5eb1-37') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:05:46.367799 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:fd:69,bridge_name='br-int',has_traffic_filtering=True,id=fe2a5eb1-3745-4099-b530-b2e55ec11296,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2a5eb1-37') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:05:46.369167 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:46.369452 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe2a5eb1-37, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:46.370518 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp5_aadrfb" returned: 0 in 0.124s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:46.373161 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:46.374820 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:05:46.376036 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:46.376036 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a37f426-838a-4997-ba97-f0823141ecea) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:46.376236 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:46.379019 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:46.380237 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:fd:69,bridge_name='br-int',has_traffic_filtering=True,id=fe2a5eb1-3745-4099-b530-b2e55ec11296,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2a5eb1-37') Jan 26 19:05:46.384886 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:46.493139 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:46.493497 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:46.577579 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for 030a77eb-256b-407c-8ebd-6a578a41570e due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:05:46.577884 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:05:46.578120 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] VM Resumed (Lifecycle Event) Jan 26 19:05:46.579691 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Instance event wait completed in 0 seconds for {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:05:46.579882 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:05:46.585501 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Instance spawned successfully. Jan 26 19:05:46.585839 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:05:46.586924 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:46.587479 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5_resize/disk /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:46.606942 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:46.607064 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:46.607343 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:46.607573 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:46.607832 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:46.608109 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:05:46.611024 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "cp -r /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5_resize/disk /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk" returned: 0 in 0.023s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:46.611266 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5_resize/disk.config /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk.config {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:46.631587 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "cp -r /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5_resize/disk.config /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk.config" returned: 0 in 0.020s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:46.631958 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5_resize/disk.info /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk.info {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:46.648792 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "cp -r /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5_resize/disk.info /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk.info" returned: 0 in 0.017s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:46.649475 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:46.649720 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:46.696009 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Port fe2a5eb1-3745-4099-b530-b2e55ec11296 binding to destination host np0005596550.novalocal is already ACTIVE {{(pid=189076) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jan 26 19:05:47.001222 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:47.089310 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:47.093165 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:05:47.127449 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:47.598347 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] During sync_power_state the instance has a pending task (rebuild_spawning). Skip. Jan 26 19:05:47.598675 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:05:47.598910 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] VM Started (Lifecycle Event) Jan 26 19:05:47.642732 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:47.643060 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:47.643270 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=189076) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}} Jan 26 19:05:47.725141 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:47.725685 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:47.725724 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:48.055608 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Acquiring lock "030a77eb-256b-407c-8ebd-6a578a41570e" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:48.056115 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "030a77eb-256b-407c-8ebd-6a578a41570e" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:48.056510 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Acquiring lock "030a77eb-256b-407c-8ebd-6a578a41570e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:48.056983 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "030a77eb-256b-407c-8ebd-6a578a41570e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:48.057341 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "030a77eb-256b-407c-8ebd-6a578a41570e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:48.063797 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Terminating instance Jan 26 19:05:48.102401 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:48.106843 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:05:48.407093 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-098374d9-28e8-4c5b-b43c-0b852664ceeb req-d7a7d206-6d0e-42cd-9c22-f3a2fe3b944c service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received event network-vif-unplugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:05:48.407269 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-098374d9-28e8-4c5b-b43c-0b852664ceeb req-d7a7d206-6d0e-42cd-9c22-f3a2fe3b944c service nova] Acquiring lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:48.407476 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-098374d9-28e8-4c5b-b43c-0b852664ceeb req-d7a7d206-6d0e-42cd-9c22-f3a2fe3b944c service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:48.407705 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-098374d9-28e8-4c5b-b43c-0b852664ceeb req-d7a7d206-6d0e-42cd-9c22-f3a2fe3b944c service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:48.408206 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-098374d9-28e8-4c5b-b43c-0b852664ceeb req-d7a7d206-6d0e-42cd-9c22-f3a2fe3b944c service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] No waiting events found dispatching network-vif-unplugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:05:48.408399 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-098374d9-28e8-4c5b-b43c-0b852664ceeb req-d7a7d206-6d0e-42cd-9c22-f3a2fe3b944c service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received unexpected event network-vif-unplugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 for instance with vm_state active and task_state resize_migrated. Jan 26 19:05:48.575103 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Acquiring lock "refresh_cache-030a77eb-256b-407c-8ebd-6a578a41570e" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:05:48.575336 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Acquired lock "refresh_cache-030a77eb-256b-407c-8ebd-6a578a41570e" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:05:48.575622 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:05:48.611533 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] During sync_power_state the instance has a pending task (deleting). Skip. Jan 26 19:05:48.661550 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-874102be-32cc-4963-80d9-356db55df285 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.018s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:48.733458 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:48.809635 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "refresh_cache-48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:05:48.809899 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquired lock "refresh_cache-48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:05:48.810136 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:05:49.079606 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:49.112701 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:05:49.212310 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:05:49.313552 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:49.552471 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:49.641874 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Updating instance_info_cache with network_info: [{"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:05:49.715613 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Releasing lock "refresh_cache-030a77eb-256b-407c-8ebd-6a578a41570e" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:05:49.716212 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:05:49.984315 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Instance destroyed successfully. Jan 26 19:05:49.984315 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lazy-loading 'resources' on Instance uuid 030a77eb-256b-407c-8ebd-6a578a41570e {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:05:50.147519 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Releasing lock "refresh_cache-48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:05:50.487796 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Deleting instance files /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e_del Jan 26 19:05:50.487796 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Deletion of /opt/stack/data/nova/instances/030a77eb-256b-407c-8ebd-6a578a41570e_del complete Jan 26 19:05:50.684475 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Starting finish_migration {{(pid=189076) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12668}} Jan 26 19:05:50.684475 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Instance directory exists: not creating {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5157}} Jan 26 19:05:50.685500 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Creating image(s) Jan 26 19:05:50.687113 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:50.753563 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.066s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:50.754223 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:05:50.754601 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:50.828607 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk --force-share --output=json" returned: 0 in 0.072s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:50.828607 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Cannot resize image /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:05:50.994961 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Took 1.28 seconds to destroy the instance on the hypervisor. Jan 26 19:05:50.995672 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:05:50.995985 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:05:50.996164 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:05:50.996532 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:51.031806 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:05:51.032123 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:51.332728 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Did not create local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5295}} Jan 26 19:05:51.332728 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Ensure instance console log exists: /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:05:51.338232 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:51.339805 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.006s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:51.340804 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:51.346035 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Start _get_guest_xml network_info=[{"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1812167825-network", "vif_mac": "fa:16:3e:9b:fd:69"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:05:51.353743 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:05:51.353743 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestJSON-server-469643394', uuid='48ff5e37-56fe-46a8-b14c-8e4cf3197fb5'), owner=OwnerMeta(userid='25c3c9ca754941ccbd986028c2a87e07', username='tempest-ServerActionsTestJSON-960489083-project-member', projectid='2efcb8570b994820a5956fab4e859054', projectname='tempest-ServerActionsTestJSON-960489083'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1812167825-network", "vif_mac": "fa:16:3e:9b:fd:69"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472351.3529325) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:05:51.355156 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:05:51.356016 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:05:51.357838 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:05:51.358675 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:05:51.360268 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:05:51.361003 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:05:51.361552 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:05:51.361992 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:05:51.362446 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:05:51.363044 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:05:51.363539 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:05:51.364259 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:05:51.364682 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:05:51.365268 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:05:51.365666 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:05:51.366216 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:05:51.370971 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk.config --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:51.379696 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:51.439562 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk.config --force-share --output=json" returned: 0 in 0.068s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:51.441804 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "/opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:51.441804 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "/opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:51.442239 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "/opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:51.444186 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-469643394',display_name='tempest-ServerActionsTestJSON-server-469643394',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestjson-server-469643394',id=67,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaqJcAWtBvnDQt3Z0Zs2SEk8GmS4qswJn8I3pLNnZ26AiUp6izAb2VATu7Ta6RkUjooYd/ncwVnO6h5/K851Ht4DSyJ8eVOthZpoT3zQfgSsI2MjV6hMkI8XyrAdvV6PQ==',key_name='tempest-keypair-571396453',keypairs=,launch_index=0,launched_at=2026-01-27T00:05:11Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-v7nt6kx2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:05:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=48ff5e37-56fe-46a8-b14c-8e4cf3197fb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1812167825-network", "vif_mac": "fa:16:3e:9b:fd:69"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:05:51.444713 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1812167825-network", "vif_mac": "fa:16:3e:9b:fd:69"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:05:51.445700 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:69,bridge_name='br-int',has_traffic_filtering=True,id=fe2a5eb1-3745-4099-b530-b2e55ec11296,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2a5eb1-37') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] End _get_guest_xml xml= Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5 Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: instance-00000043 Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: 262144 Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestJSON-server-469643394 Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:05:51 Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: 256 Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: ide Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: pc Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestJSON-960489083-project-member Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestJSON-960489083 Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5 Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5 Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: Jan 26 19:05:51.447691 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:05:51.451024 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-469643394',display_name='tempest-ServerActionsTestJSON-server-469643394',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestjson-server-469643394',id=67,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaqJcAWtBvnDQt3Z0Zs2SEk8GmS4qswJn8I3pLNnZ26AiUp6izAb2VATu7Ta6RkUjooYd/ncwVnO6h5/K851Ht4DSyJ8eVOthZpoT3zQfgSsI2MjV6hMkI8XyrAdvV6PQ==',key_name='tempest-keypair-571396453',keypairs=,launch_index=0,launched_at=2026-01-27T00:05:11Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-v7nt6kx2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:05:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=48ff5e37-56fe-46a8-b14c-8e4cf3197fb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1812167825-network", "vif_mac": "fa:16:3e:9b:fd:69"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:05:51.451024 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1812167825-network", "vif_mac": "fa:16:3e:9b:fd:69"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:05:51.451422 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:69,bridge_name='br-int',has_traffic_filtering=True,id=fe2a5eb1-3745-4099-b530-b2e55ec11296,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2a5eb1-37') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:05:51.451844 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:69,bridge_name='br-int',has_traffic_filtering=True,id=fe2a5eb1-3745-4099-b530-b2e55ec11296,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2a5eb1-37') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:05:51.452360 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:51.452733 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:51.453108 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:05:51.453945 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:51.454221 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8a316f4-72ff-58a7-81e7-47dcdf74e3a4', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:51.455656 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:51.458065 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:05:51.458496 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:51.461161 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:51.461539 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe2a5eb1-37, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:51.462050 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe2a5eb1-37, col_values=(('qos', UUID('8e01ca6a-63b5-412c-984a-c968fea0fe4c')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:51.462357 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe2a5eb1-37, col_values=(('external_ids', {'iface-id': 'fe2a5eb1-3745-4099-b530-b2e55ec11296', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:fd:69', 'vm-uuid': '48ff5e37-56fe-46a8-b14c-8e4cf3197fb5'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:51.463563 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:51.466841 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:05:51.473038 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:51.474377 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:69,bridge_name='br-int',has_traffic_filtering=True,id=fe2a5eb1-3745-4099-b530-b2e55ec11296,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2a5eb1-37') Jan 26 19:05:51.534849 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:05:52.003569 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:52.040791 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Took 1.04 seconds to deallocate network for instance. Jan 26 19:05:52.548808 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:52.548808 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:52.799957 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:05:53.010433 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:05:53.010433 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:05:53.010433 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] No VIF found with MAC fa:16:3e:9b:fd:69, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:05:53.010433 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Using config drive Jan 26 19:05:53.080675 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:53.090447 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:53.092937 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:53.286220 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c6338adc-e74e-4fdd-b9a8-10bbbb995c1e req-9288d864-585c-4527-bd5b-a8ddcddd26af service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received event network-vif-plugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:05:53.287338 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c6338adc-e74e-4fdd-b9a8-10bbbb995c1e req-9288d864-585c-4527-bd5b-a8ddcddd26af service nova] Acquiring lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:53.287338 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c6338adc-e74e-4fdd-b9a8-10bbbb995c1e req-9288d864-585c-4527-bd5b-a8ddcddd26af service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:53.287338 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c6338adc-e74e-4fdd-b9a8-10bbbb995c1e req-9288d864-585c-4527-bd5b-a8ddcddd26af service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:53.287338 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c6338adc-e74e-4fdd-b9a8-10bbbb995c1e req-9288d864-585c-4527-bd5b-a8ddcddd26af service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] No waiting events found dispatching network-vif-plugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:05:53.287338 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-c6338adc-e74e-4fdd-b9a8-10bbbb995c1e req-9288d864-585c-4527-bd5b-a8ddcddd26af service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received unexpected event network-vif-plugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 for instance with vm_state active and task_state resize_finish. Jan 26 19:05:53.302697 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Instance event wait completed in 0 seconds for {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:05:53.306990 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:05:53.310532 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5 due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:05:53.311102 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:05:53.311392 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] VM Resumed (Lifecycle Event) Jan 26 19:05:53.319164 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Instance running successfully. Jan 26 19:05:53.326896 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Failed to set time: agent not configured {{(pid=189076) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}} Jan 26 19:05:53.328442 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fefa0800-6ac7-4374-92a9-50902338502b tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] finish_migration finished successfully. {{(pid=189076) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12763}} Jan 26 19:05:53.389423 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:53.394320 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:53.400430 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:53.403308 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:53.814812 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.266s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:53.818646 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:53.858046 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:05:53.924533 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Deleted allocations for instance 030a77eb-256b-407c-8ebd-6a578a41570e Jan 26 19:05:54.232496 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "e6131b49-ccfa-43e4-9480-76d9062c4e48" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:54.233095 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "e6131b49-ccfa-43e4-9480-76d9062c4e48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:54.362360 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] During sync_power_state the instance has a pending task (resize_finish). Skip. Jan 26 19:05:54.362601 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:05:54.362783 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] VM Started (Lifecycle Event) Jan 26 19:05:54.736104 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lazy-loading 'flavor' on Instance uuid e6131b49-ccfa-43e4-9480-76d9062c4e48 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:05:54.767889 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:54.848101 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:54.848478 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:54.848808 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:54.865514 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:05:54.869612 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:05:54.934506 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ad4c92a-e451-4b72-8b52-f9242332a1f9 tempest-ServersListShow296Test-1010639838 tempest-ServersListShow296Test-1010639838-project-member] Lock "030a77eb-256b-407c-8ebd-6a578a41570e" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.878s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:55.240020 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Ignoring supplied device name: /dev/vdb Jan 26 19:05:55.361253 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e6ab01bb-83fc-4876-a355-24611dd4a237 req-6bf10a18-def9-4bc3-8bc4-c3c2827b7227 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received event network-vif-plugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:05:55.361656 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e6ab01bb-83fc-4876-a355-24611dd4a237 req-6bf10a18-def9-4bc3-8bc4-c3c2827b7227 service nova] Acquiring lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:55.362031 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e6ab01bb-83fc-4876-a355-24611dd4a237 req-6bf10a18-def9-4bc3-8bc4-c3c2827b7227 service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:55.362436 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e6ab01bb-83fc-4876-a355-24611dd4a237 req-6bf10a18-def9-4bc3-8bc4-c3c2827b7227 service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:55.362736 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e6ab01bb-83fc-4876-a355-24611dd4a237 req-6bf10a18-def9-4bc3-8bc4-c3c2827b7227 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] No waiting events found dispatching network-vif-plugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:05:55.363116 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-e6ab01bb-83fc-4876-a355-24611dd4a237 req-6bf10a18-def9-4bc3-8bc4-c3c2827b7227 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received unexpected event network-vif-plugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 for instance with vm_state resized and task_state resize_reverting. Jan 26 19:05:55.372190 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] During sync_power_state the instance has a pending task (resize_reverting). Skip. Jan 26 19:05:55.403659 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Port fe2a5eb1-3745-4099-b530-b2e55ec11296 binding to destination host np0005596550.novalocal is already ACTIVE {{(pid=189076) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jan 26 19:05:55.403868 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "refresh_cache-48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:05:55.403999 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquired lock "refresh_cache-48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:05:55.404156 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:05:55.743083 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "e6131b49-ccfa-43e4-9480-76d9062c4e48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.510s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:55.907043 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:56.252791 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:05:56.433462 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Updating instance_info_cache with network_info: [{"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:05:56.465508 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:56.936049 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Releasing lock "refresh_cache-48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:05:57.008562 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:57.116025 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "e6131b49-ccfa-43e4-9480-76d9062c4e48" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:57.116025 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "e6131b49-ccfa-43e4-9480-76d9062c4e48" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:57.116256 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Attaching volume fc88f51d-d7b1-4097-802e-4391470eeab1 to /dev/vdb Jan 26 19:05:57.183234 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': True, 'host': 'np0005596550.novalocal', 'execute': None}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:05:57.183808 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:57.192579 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:57.193337 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a64f2f-8be2-46ab-929e-248af555e845]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:05:57.196520 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[42918425-d528-4a67-a757-e606200b5d1d]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:05:57.196520 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:05:57.196520 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:05:57.196520 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:05:57.196520 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:05:57.196520 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:05:57.196520 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:05:57.196520 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:05:57.196520 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:05:57.196520 np0005596550.novalocal nova-compute[189076]: with open_scini_device() as fd: Jan 26 19:05:57.196520 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:05:57.196520 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:05:57.196520 np0005596550.novalocal nova-compute[189076]: return next(self.gen) Jan 26 19:05:57.196520 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^ Jan 26 19:05:57.196520 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:05:57.196520 np0005596550.novalocal nova-compute[189076]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:05:57.196520 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:05:57.196520 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:05:57.196520 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[42918425-d528-4a67-a757-e606200b5d1d]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:05:57.196520 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.scaleio [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:05:57.196968 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.scaleio [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:05:57.197387 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:57.206836 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:57.206912 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3eab14-a15f-445d-9458-e2714c4ee6b5]: (4, ('/dev/vda2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:05:57.208501 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:57.217991 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:57.218158 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1db2c14-6946-4f9e-b4f5-5cecb6c1455d]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:05:57.221128 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[665e4e17-0997-4f72-9bb3-c86a0ff5a328]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:05:57.221412 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Running cmd (subprocess): nvme version {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:57.238913 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] 'nvme version' failed. Not Retrying. {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:05:57.238913 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] nvme not present on system {{(pid=189076) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:05:57.239761 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=189076) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:05:57.241338 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.lightos [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::64f3:a5ff:fe22:3e52', 'fe80::fc16:3eff:fe5d:9ebd', 'fe80::fc16:3eff:fe5b:de3a', 'fe80::fc16:3eff:fe9b:370d', 'fe80::801e:39ff:fe6a:9a', 'fe80::fc16:3eff:fe9b:fd69', 'fe80::3c50:eeff:fea8:7b36'] Jan 26 19:05:57.241464 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:05:57.241590 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:05:57.242040 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] <== get_connector_properties: return (59ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': True, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::64f3:a5ff:fe22:3e52', 'fe80::fc16:3eff:fe5d:9ebd', 'fe80::fc16:3eff:fe5b:de3a', 'fe80::fc16:3eff:fe9b:370d', 'fe80::801e:39ff:fe6a:9a', 'fe80::fc16:3eff:fe9b:fd69', 'fe80::3c50:eeff:fea8:7b36']} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:05:57.242291 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.block_device [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Updating existing volume attachment record: 88d060a3-97a8-429a-9f2d-14fb5fd7b074 {{(pid=189076) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jan 26 19:05:57.439730 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Creating tmpfile /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/tmpzzcbibfr to verify with other compute node that the instance is on the same shared storage. {{(pid=189076) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10477}} Jan 26 19:05:57.972069 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:58.005841 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:58.011000 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:58.013874 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:58.036806 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:58.037007 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:58.170793 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:58.177558 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:58.199787 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Instance destroyed successfully. Jan 26 19:05:58.199787 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'resources' on Instance uuid 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:05:58.244573 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-11f929ed-a45b-4654-9a5e-3da856cbf025 req-34711c48-97b6-450a-b1d3-678a351fadb5 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received event network-vif-unplugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:05:58.244573 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-11f929ed-a45b-4654-9a5e-3da856cbf025 req-34711c48-97b6-450a-b1d3-678a351fadb5 service nova] Acquiring lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:58.244573 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-11f929ed-a45b-4654-9a5e-3da856cbf025 req-34711c48-97b6-450a-b1d3-678a351fadb5 service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:58.244573 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-11f929ed-a45b-4654-9a5e-3da856cbf025 req-34711c48-97b6-450a-b1d3-678a351fadb5 service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:58.244573 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-11f929ed-a45b-4654-9a5e-3da856cbf025 req-34711c48-97b6-450a-b1d3-678a351fadb5 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] No waiting events found dispatching network-vif-unplugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:05:58.244573 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-11f929ed-a45b-4654-9a5e-3da856cbf025 req-34711c48-97b6-450a-b1d3-678a351fadb5 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received unexpected event network-vif-unplugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 for instance with vm_state resized and task_state resize_reverting. Jan 26 19:05:58.546526 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'flavor' on Instance uuid c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:05:58.546526 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Acquiring lock "2f9056ef-40b7-40df-8a63-d2328ad5987e" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:58.546526 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "2f9056ef-40b7-40df-8a63-d2328ad5987e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:58.702875 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-469643394',display_name='tempest-ServerActionsTestJSON-server-469643394',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestjson-server-469643394',id=67,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaqJcAWtBvnDQt3Z0Zs2SEk8GmS4qswJn8I3pLNnZ26AiUp6izAb2VATu7Ta6RkUjooYd/ncwVnO6h5/K851Ht4DSyJ8eVOthZpoT3zQfgSsI2MjV6hMkI8XyrAdvV6PQ==',key_name='tempest-keypair-571396453',keypairs=,launch_index=0,launched_at=2026-01-27T00:05:53Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-v7nt6kx2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:05:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=48ff5e37-56fe-46a8-b14c-8e4cf3197fb5,vcpu_model=,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:05:58.706852 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:05:58.707279 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:fd:69,bridge_name='br-int',has_traffic_filtering=True,id=fe2a5eb1-3745-4099-b530-b2e55ec11296,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2a5eb1-37') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:05:58.708012 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:fd:69,bridge_name='br-int',has_traffic_filtering=True,id=fe2a5eb1-3745-4099-b530-b2e55ec11296,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2a5eb1-37') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:05:58.710692 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:58.711312 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe2a5eb1-37, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:58.750586 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:58.753846 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:58.753846 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:58.754654 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e01ca6a-63b5-412c-984a-c968fea0fe4c) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:05:58.758936 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:05:58.760383 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:05:58.762466 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:fd:69,bridge_name='br-int',has_traffic_filtering=True,id=fe2a5eb1-3745-4099-b530-b2e55ec11296,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2a5eb1-37') Jan 26 19:05:58.765856 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:58.766241 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:05:59.049253 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:05:59.271532 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'migration_context' on Instance uuid 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:05:59.554875 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.515s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:05:59.592334 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:05:59.778129 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Object Instance<48ff5e37-56fe-46a8-b14c-8e4cf3197fb5> lazy-loaded attributes: resources,migration_context {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:05:59.987133 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:06:00.405971 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-000885e7-9eb9-4ea7-b561-e463854486bb req-f22bf3ee-f466-471c-8700-913c604acafe service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received event network-vif-unplugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:06:00.405971 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-000885e7-9eb9-4ea7-b561-e463854486bb req-f22bf3ee-f466-471c-8700-913c604acafe service nova] Acquiring lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:00.405971 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-000885e7-9eb9-4ea7-b561-e463854486bb req-f22bf3ee-f466-471c-8700-913c604acafe service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:00.405971 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-000885e7-9eb9-4ea7-b561-e463854486bb req-f22bf3ee-f466-471c-8700-913c604acafe service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:00.405971 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-000885e7-9eb9-4ea7-b561-e463854486bb req-f22bf3ee-f466-471c-8700-913c604acafe service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] No waiting events found dispatching network-vif-unplugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:06:00.405971 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-000885e7-9eb9-4ea7-b561-e463854486bb req-f22bf3ee-f466-471c-8700-913c604acafe service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received unexpected event network-vif-unplugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 for instance with vm_state resized and task_state resize_reverting. Jan 26 19:06:00.489786 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:06:00.704666 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:00.705086 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:00.705472 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Attaching volume 8ca88aff-367a-4ce7-9a74-4ca46af97c3f to /dev/vdb Jan 26 19:06:00.745993 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': True, 'host': 'np0005596550.novalocal', 'execute': None}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:06:00.747469 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:00.755601 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:00.755723 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ab9a6d-57a5-4809-8a58-216c62b08beb]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:00.757756 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[21278a47-323c-478f-8317-351050d02c32]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:06:00.757756 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:06:00.757756 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:06:00.757756 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:06:00.757756 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:00.757756 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:06:00.757756 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:06:00.757756 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:00.757756 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:06:00.757756 np0005596550.novalocal nova-compute[189076]: with open_scini_device() as fd: Jan 26 19:06:00.757756 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:00.757756 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:06:00.757756 np0005596550.novalocal nova-compute[189076]: return next(self.gen) Jan 26 19:06:00.757756 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^ Jan 26 19:06:00.757756 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:06:00.757756 np0005596550.novalocal nova-compute[189076]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:06:00.757756 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:00.757756 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:06:00.758000 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[21278a47-323c-478f-8317-351050d02c32]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:00.758365 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.scaleio [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:06:00.758511 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.scaleio [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:06:00.759465 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:00.767751 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:00.767952 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d39d8e2-3bc2-44af-8a4c-b56342ffb272]: (4, ('/dev/vda2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:00.768883 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:00.778753 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:00.779117 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79dc3ba-8e2a-4df9-813d-0dea5ce70e2d]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:00.780356 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4f440b-ed0e-42b6-834e-5687b2db1145]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:00.780701 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): nvme version {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:00.797265 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] 'nvme version' failed. Not Retrying. {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:06:00.797544 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] nvme not present on system {{(pid=189076) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:06:00.799004 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=189076) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:06:00.799906 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.lightos [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::64f3:a5ff:fe22:3e52', 'fe80::fc16:3eff:fe5d:9ebd', 'fe80::fc16:3eff:fe5b:de3a', 'fe80::fc16:3eff:fe9b:370d', 'fe80::801e:39ff:fe6a:9a'] Jan 26 19:06:00.800086 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:06:00.800262 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:06:00.800628 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] <== get_connector_properties: return (54ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': True, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::64f3:a5ff:fe22:3e52', 'fe80::fc16:3eff:fe5d:9ebd', 'fe80::fc16:3eff:fe5b:de3a', 'fe80::fc16:3eff:fe9b:370d', 'fe80::801e:39ff:fe6a:9a']} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:06:00.800921 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.block_device [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Updating existing volume attachment record: 1cecf009-3191-4625-8892-49e786fa503e {{(pid=189076) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jan 26 19:06:00.824285 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Calling os-brick to attach iSCSI Volume {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jan 26 19:06:00.825027 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1', 'target_lun': 0, 'volume_id': 'fc88f51d-d7b1-4097-802e-4391470eeab1', 'auth_method': 'CHAP', 'auth_username': 'AqXp2jypWCEhwN2JacNe', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:06:00.825263 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:06:00.825737 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:06:00.826072 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1', 'target_lun': 0, 'volume_id': 'fc88f51d-d7b1-4097-802e-4391470eeab1', 'auth_method': 'CHAP', 'auth_username': 'AqXp2jypWCEhwN2JacNe', 'auth_password': '26wbYZuFr7K6fHkj', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True} {{(pid=189076) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:06:00.826878 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:00.835689 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:06:00.837177 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[341fbc72-e606-4922-b3db-315f9b0d1f90]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:06:00.837177 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:06:00.837177 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:06:00.837177 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:06:00.837177 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:00.837177 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:06:00.837177 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:06:00.837177 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:00.837177 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:06:00.837177 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:06:00.837177 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:00.837177 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:06:00.837177 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:06:00.837177 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:00.837177 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:06:00.837177 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:06:00.837177 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:00.837177 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:06:00.837177 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:06:00.837177 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:06:00.837177 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:06:00.837177 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:06:00.838317 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[341fbc72-e606-4922-b3db-315f9b0d1f90]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:00.838982 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:06:00.839556 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:06:00.839837 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:06:00.840807 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:00.853385 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260" returned: 21 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:00.853716 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf4c00b-bf0a-4903-9ab7-425b579aeb4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:00.854056 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:06:00.854056 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:00.854942 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260 --interface default --op new {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:00.864515 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:00.866279 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a057c6bd-49c0-4bf7-9c7f-eed638ef7339]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:00.866553 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1] added Jan 26 19:06:00.866553 np0005596550.novalocal nova-compute[189076]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:06:00.866553 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:06:00.866553 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:06:00.866553 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:00.866716 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=189076) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:06:00.866978 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.027(s), this was the 1st time calling it. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:06:00.867158 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:06:01.501976 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 2.734s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:01.506497 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.914s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:01.516830 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:06:01.517013 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Claim successful on node np0005596550.novalocal Jan 26 19:06:01.867884 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:06:01.868610 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:01.878233 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:01.878390 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faa052c-48f9-4fb2-b178-45248571c466]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.name = iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.tpgt = -1 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.startup = automatic Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.leading_login = No Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.iscsi_ifacename = default Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.net_ifacename = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.ipaddress = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.prefix_len = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.hwaddress = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.transport_name = tcp Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.initiatorname = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.state = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.vlan_id = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.vlan_priority = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.vlan_state = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.iface_num = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.mtu = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.port = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.bootproto = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.subnet_mask = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.gateway = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id_state = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.dhcp_dns = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.dhcp_learn_iqn = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.dhcp_req_vendor_id_state = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id_state = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.dhcp_slp_da = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.fragmentation = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.gratuitous_arp = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.incoming_forwarding = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.tos_state = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.tos = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.ttl = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.delayed_ack = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.tcp_nagle = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf_state = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.tcp_timer_scale = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.tcp_timestamp = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.redirect = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.def_task_mgmt_timeout = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.header_digest = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.data_digest = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.immediate_data = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.initial_r2t = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.data_seq_inorder = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.data_pdu_inorder = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.erl = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.max_receive_data_len = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.first_burst_len = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.max_outstanding_r2t = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.max_burst_len = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.chap_auth = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.bidi_chap = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.strict_login_compliance = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.discovery_auth = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: iface.discovery_logout = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.discovery_address = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.discovery_port = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.discovery_type = fw Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.initial_cmdsn = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.initial_login_retry_max = 8 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.xmit_thread_priority = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.cmds_max = 128 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.queue_depth = 32 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.nr_sessions = 1 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.auth.authmethod = None Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.auth.username = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.auth.password = *** Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.auth.username_in = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.auth.password_in = Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.timeo.replacement_timeout = 120 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FastAbort = Yes Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.InitialR2T = No Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ImmediateData = Yes Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxConnections = 1 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ERL = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.scan = auto Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.reopen_max = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.session.conn_reopen_log_freq = 1 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.conn[0].address = 38.102.83.18 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.conn[0].port = 3260 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.conn[0].startup = manual Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.window_size = 524288 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.DataDigest = None Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.IFMarker = No Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.OFMarker = No Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: # END RECORD Jan 26 19:06:01.879260 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:01.880540 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:01.886297 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.006s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:01.886432 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a45d1dc-bec6-4e78-ad38-ccc34d6af75b]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:01.886731 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:01.888146 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:01.898444 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:01.899147 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[27284a91-2487-4a26-a22f-7406d2138346]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:01.899480 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:01.900421 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v AqXp2jypWCEhwN2JacNe {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:01.907447 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v AqXp2jypWCEhwN2JacNe" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:01.907552 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f86045-1782-428f-bcb4-01822b0e9fc6]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:01.907856 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AqXp2jypWCEhwN2JacNe'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:01.908563 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:01.916120 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:01.916314 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad617de-4a4f-4f41-8543-fdcb9d5e2f7c]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:01.916612 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:01.917264 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:01.923640 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.006s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:01.923885 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23ad0c7-b4f5-47a3-80d3-a2b6c72ed272]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:01.924092 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jan 26 19:06:01.924092 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:06:01.924219 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jan 26 19:06:01.924219 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:06:01.924346 np0005596550.novalocal nova-compute[189076]: WARNING os_brick.initiator.connectors.iscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jan 26 19:06:01.924346 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:01.924986 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260 --login {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:01.938783 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260 --login" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:01.938783 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa46a7e-0867-4d8a-b4cc-8bf6cad0bb36]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:01.938783 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1, portal: 38.102.83.18,3260] successful. Jan 26 19:06:01.938783 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:01.939100 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:01.945942 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:01.946141 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae3a2f5-ed53-4055-854e-bfa62090dfee]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:01.946444 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:01.947313 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:01.956995 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:01.957117 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef105757-a367-422c-bf9f-34f5aac64ff4]: (4, ('tcp: [8] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:01.957466 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 (non-flash) Jan 26 19:06:01.957466 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:06:01.957560 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsi session list stdout=tcp: [8] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 (non-flash) Jan 26 19:06:01.957560 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:06:01.957863 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.118s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:06:01.958005 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Connected to 38.102.83.18:3260 {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:06:01.958387 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] HCTL ('2', '-', '-', 0) found on session 8 with lun 0 {{(pid=189076) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:06:01.958520 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Scanning host 2 c: -, t: -, l: 0) {{(pid=189076) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:06:01.959272 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host2/scan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:01.976189 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host2/scan" returned: 0 in 0.016s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:01.976292 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fe5b3d-6300-4029-b60b-d7d237a40b4d]: (4, ('- - 0', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:01.976855 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Searching for a device in session 8 and hctl ['2', '*', '*', 0] yield: None {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:06:02.008740 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:02.782960 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:06:02.978449 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Searching for a device in session 8 and hctl ['2', '*', '*', 0] yield: sda {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:06:02.979058 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Connected to sda using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1', 'target_lun': 0, 'volume_id': 'fc88f51d-d7b1-4097-802e-4391470eeab1', 'auth_method': 'CHAP', 'auth_username': 'AqXp2jypWCEhwN2JacNe', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True} {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:06:02.979808 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.154s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:06:02.980058 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] <== connect_volume: return (2154ms) {'type': 'block', 'scsi_wwn': '360014057b7fdbbf9c6b414fb7d7ed016', 'path': '/dev/sda'} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:06:02.980286 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '360014057b7fdbbf9c6b414fb7d7ed016', 'path': '/dev/sda'} {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jan 26 19:06:02.985444 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lazy-loading 'flavor' on Instance uuid e6131b49-ccfa-43e4-9480-76d9062c4e48 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:06:03.053432 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Swapping old allocation on dict_keys(['f627156c-932e-4a32-97b3-315a994a2ac9']) held by migration cfca8fbb-dda4-4575-938e-2c7ccf441948 for instance Jan 26 19:06:03.108146 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Overwriting current allocation {'allocations': {'f627156c-932e-4a32-97b3-315a994a2ac9': {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}, 'generation': 94}}, 'project_id': '2efcb8570b994820a5956fab4e859054', 'user_id': '25c3c9ca754941ccbd986028c2a87e07', 'consumer_generation': 1} on consumer 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5 {{(pid=189076) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}} Jan 26 19:06:03.168677 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:03.209540 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "refresh_cache-48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:06:03.209702 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquired lock "refresh_cache-48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:06:03.209911 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:06:03.286302 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:06:03.491652 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] attach device xml: Jan 26 19:06:03.491652 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:03.491652 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:03.491652 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:03.491652 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:03.491652 np0005596550.novalocal nova-compute[189076]: fc88f51d-d7b1-4097-802e-4391470eeab1 Jan 26 19:06:03.491652 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:03.491652 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:330}} Jan 26 19:06:03.713180 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:03.803184 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.293s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:03.803184 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:06:03.803184 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:03.984255 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:04.108577 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Updating instance_info_cache with network_info: [{"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:06:04.307714 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Not allocating networking since 'none' was specified. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2039}} Jan 26 19:06:04.352025 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Calling os-brick to attach iSCSI Volume {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jan 26 19:06:04.352025 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'target_lun': 0, 'volume_id': '8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'auth_method': 'CHAP', 'auth_username': 'DJGdCSYcXoX7W45zGsrh', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:06:04.352025 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:06:04.352372 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:06:04.352741 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'target_lun': 0, 'volume_id': '8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'auth_method': 'CHAP', 'auth_username': 'DJGdCSYcXoX7W45zGsrh', 'auth_password': 'QYEGK4BnLv8mKnEB', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True} {{(pid=189076) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:06:04.353568 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:04.357726 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:06:04.358892 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[32a9e2ae-955c-40ef-b371-7843c25f8417]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:06:04.358892 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:06:04.358892 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:06:04.358892 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:06:04.358892 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:04.358892 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:06:04.358892 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:06:04.358892 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:04.358892 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:06:04.358892 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:06:04.358892 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:04.358892 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:06:04.358892 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:06:04.358892 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:04.358892 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:06:04.358892 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:06:04.358892 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:04.358892 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:06:04.358892 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:06:04.358892 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:06:04.358892 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:06:04.358892 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:06:04.360137 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a9e2ae-955c-40ef-b371-7843c25f8417]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:04.360443 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:06:04.361055 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:06:04.361509 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:06:04.362496 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:04.370750 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260" returned: 21 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:04.370750 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc4a7b6-d941-4831-851e-d13621367c66]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:04.370750 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:06:04.370750 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:04.371125 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --interface default --op new {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:04.381252 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:04.381252 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[3805eeae-f166-495c-b71a-0fdb8698fb11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:04.381252 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f] added Jan 26 19:06:04.381252 np0005596550.novalocal nova-compute[189076]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:06:04.381252 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:06:04.381252 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:06:04.381252 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:04.381252 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=189076) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:06:04.381252 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.019(s), this was the 1st time calling it. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:06:04.381252 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:06:04.611897 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Releasing lock "refresh_cache-48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:06:04.611897 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Starting finish_revert_migration {{(pid=189076) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12813}} Jan 26 19:06:04.621582 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Start _get_guest_xml network_info=[{"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:06:04.628305 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:06:04.630251 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestJSON-server-469643394', uuid='48ff5e37-56fe-46a8-b14c-8e4cf3197fb5'), owner=OwnerMeta(userid='25c3c9ca754941ccbd986028c2a87e07', username='tempest-ServerActionsTestJSON-960489083-project-member', projectid='2efcb8570b994820a5956fab4e859054', projectname='tempest-ServerActionsTestJSON-960489083'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472364.6296935) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:06:04.631854 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:06:04.632503 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:06:04.634464 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:06:04.635078 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:06:04.636646 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:06:04.637309 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:06:04.637847 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:06:04.638211 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:06:04.638750 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:06:04.639252 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:06:04.639615 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:06:04.640266 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:06:04.640647 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:06:04.641056 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:06:04.641436 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:06:04.641904 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:06:04.642322 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'vcpu_model' on Instance uuid 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:06:04.809981 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:06:04.979721 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:06:04.979721 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] VM Stopped (Lifecycle Event) Jan 26 19:06:05.067589 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:06:05.068340 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] No BDM found with device name vdb, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:06:05.068602 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:06:05.068888 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] No VIF found with MAC fa:16:3e:9b:37:0d, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:06:05.147124 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk.config --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:05.222002 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk.config --force-share --output=json" returned: 0 in 0.074s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:05.222469 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "/opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:05.224908 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "/opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:05.224908 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "/opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:05.225289 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-469643394',display_name='tempest-ServerActionsTestJSON-server-469643394',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestjson-server-469643394',id=67,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaqJcAWtBvnDQt3Z0Zs2SEk8GmS4qswJn8I3pLNnZ26AiUp6izAb2VATu7Ta6RkUjooYd/ncwVnO6h5/K851Ht4DSyJ8eVOthZpoT3zQfgSsI2MjV6hMkI8XyrAdvV6PQ==',key_name='tempest-keypair-571396453',keypairs=,launch_index=0,launched_at=2026-01-27T00:05:53Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-v7nt6kx2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:05:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=48ff5e37-56fe-46a8-b14c-8e4cf3197fb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:06:05.225815 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:06:05.227079 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:69,bridge_name='br-int',has_traffic_filtering=True,id=fe2a5eb1-3745-4099-b530-b2e55ec11296,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2a5eb1-37') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] End _get_guest_xml xml= Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5 Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: instance-00000043 Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestJSON-server-469643394 Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:06:04 Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: ide Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: pc Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestJSON-960489083-project-member Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestJSON-960489083 Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5 Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5 Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:05.230120 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:06:05.232659 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Preparing to wait for external event network-vif-plugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:06:05.234251 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:05.234251 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:05.234251 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:05.234251 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-469643394',display_name='tempest-ServerActionsTestJSON-server-469643394',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestjson-server-469643394',id=67,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaqJcAWtBvnDQt3Z0Zs2SEk8GmS4qswJn8I3pLNnZ26AiUp6izAb2VATu7Ta6RkUjooYd/ncwVnO6h5/K851Ht4DSyJ8eVOthZpoT3zQfgSsI2MjV6hMkI8XyrAdvV6PQ==',key_name='tempest-keypair-571396453',keypairs=,launch_index=0,launched_at=2026-01-27T00:05:53Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-v7nt6kx2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:05:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=48ff5e37-56fe-46a8-b14c-8e4cf3197fb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:06:05.234902 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:06:05.235845 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:69,bridge_name='br-int',has_traffic_filtering=True,id=fe2a5eb1-3745-4099-b530-b2e55ec11296,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2a5eb1-37') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:06:05.236140 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:69,bridge_name='br-int',has_traffic_filtering=True,id=fe2a5eb1-3745-4099-b530-b2e55ec11296,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2a5eb1-37') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:06:05.237880 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:05.238136 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:06:05.238524 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:06:05.239521 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:05.239815 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8a316f4-72ff-58a7-81e7-47dcdf74e3a4', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:06:05.240704 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:05.243546 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:05.244556 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:05.244797 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe2a5eb1-37, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:06:05.245122 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe2a5eb1-37, col_values=(('qos', UUID('6898e3c7-4835-41ff-af31-416c93eefba6')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:06:05.245346 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe2a5eb1-37, col_values=(('external_ids', {'iface-id': 'fe2a5eb1-3745-4099-b530-b2e55ec11296', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:fd:69', 'vm-uuid': '48ff5e37-56fe-46a8-b14c-8e4cf3197fb5'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:06:05.246537 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:05.248780 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:06:05.255743 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:05.255743 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:69,bridge_name='br-int',has_traffic_filtering=True,id=fe2a5eb1-3745-4099-b530-b2e55ec11296,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2a5eb1-37') Jan 26 19:06:05.315583 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:06:05.330803 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:05.338238 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:05.382368 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:06:05.385015 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:05.390876 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:05.391127 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e8f1e4-e305-4c65-b4d4-a2404df9bab5]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.name = iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.tpgt = -1 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.startup = automatic Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.leading_login = No Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.iscsi_ifacename = default Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.net_ifacename = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.ipaddress = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.prefix_len = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.hwaddress = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.transport_name = tcp Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.initiatorname = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.state = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.vlan_id = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.vlan_priority = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.vlan_state = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.iface_num = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.mtu = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.port = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.bootproto = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.subnet_mask = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.gateway = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id_state = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.dhcp_dns = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.dhcp_learn_iqn = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.dhcp_req_vendor_id_state = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id_state = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.dhcp_slp_da = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.fragmentation = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.gratuitous_arp = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.incoming_forwarding = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.tos_state = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.tos = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.ttl = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.delayed_ack = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.tcp_nagle = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf_state = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.tcp_timer_scale = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.tcp_timestamp = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.redirect = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.def_task_mgmt_timeout = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.header_digest = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.data_digest = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.immediate_data = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.initial_r2t = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.data_seq_inorder = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.data_pdu_inorder = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.erl = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.max_receive_data_len = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.first_burst_len = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.max_outstanding_r2t = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.max_burst_len = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.chap_auth = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.bidi_chap = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.strict_login_compliance = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.discovery_auth = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: iface.discovery_logout = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.discovery_address = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.discovery_port = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.discovery_type = fw Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.initial_cmdsn = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.initial_login_retry_max = 8 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.xmit_thread_priority = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.cmds_max = 128 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.queue_depth = 32 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.nr_sessions = 1 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.auth.authmethod = None Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.auth.username = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.auth.password = *** Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.auth.username_in = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.auth.password_in = Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.timeo.replacement_timeout = 120 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FastAbort = Yes Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.InitialR2T = No Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ImmediateData = Yes Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxConnections = 1 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ERL = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.scan = auto Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.reopen_max = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.session.conn_reopen_log_freq = 1 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.conn[0].address = 38.102.83.18 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.conn[0].port = 3260 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.conn[0].startup = manual Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.window_size = 524288 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.DataDigest = None Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.IFMarker = No Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.OFMarker = No Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: # END RECORD Jan 26 19:06:05.392754 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:05.394332 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:05.405875 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:05.406079 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d6ba3f-a293-4e74-b78b-64381cbd4bc9]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:05.406533 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:05.409794 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:05.421813 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:05.421813 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d710bc6d-2b38-4a97-921c-8c4860938eb5]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:05.426794 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:05.434931 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.auth.username -v DJGdCSYcXoX7W45zGsrh {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:05.438049 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.auth.username -v DJGdCSYcXoX7W45zGsrh" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:05.438162 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39f1c97-3150-4b20-aa9d-9856b2dd1054]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:05.438469 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DJGdCSYcXoX7W45zGsrh'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:05.439693 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:05.449411 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:05.449551 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[04419002-bd50-46f4-bdca-46aa5c3430f5]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:05.450098 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:05.450971 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:05.459667 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:05.459803 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[904dfd52-9dd0-49d9-b442-4a4a8cf85217]: (4, ('tcp: [8] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:05.460306 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 (non-flash) Jan 26 19:06:05.460306 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:06:05.460441 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsi session list stdout=tcp: [8] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 (non-flash) Jan 26 19:06:05.460441 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:06:05.462785 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --login {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:05.476668 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --login" returned: 0 in 0.015s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:05.477339 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d747790-75ae-451a-84a8-9130a48ec079]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:05.477802 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f, portal: 38.102.83.18,3260] successful. Jan 26 19:06:05.477802 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:05.478475 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:05.482402 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-247f6160-1f67-4de0-9ff8-d137169b6e11 None None] [instance: 030a77eb-256b-407c-8ebd-6a578a41570e] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:06:05.488925 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:05.489045 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3118706-9df5-48c6-b26d-28785fbc1314]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:05.489312 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:05.492196 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:05.501418 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:05.501741 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdc90c3-4002-4bdf-ba0b-505e0ae5a693]: (4, ('tcp: [8] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 (non-flash)\ntcp: [9] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:05.502267 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 (non-flash) Jan 26 19:06:05.502267 np0005596550.novalocal nova-compute[189076]: tcp: [9] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f (non-flash) Jan 26 19:06:05.502267 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:06:05.502407 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsi session list stdout=tcp: [8] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 (non-flash) Jan 26 19:06:05.502407 np0005596550.novalocal nova-compute[189076]: tcp: [9] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f (non-flash) Jan 26 19:06:05.502407 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:06:05.502827 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:06:05.502968 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Connected to 38.102.83.18:3260 {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:06:05.503378 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] HCTL ('3', '-', '-', 0) found on session 9 with lun 0 {{(pid=189076) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:06:05.503507 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Scanning host 3 c: -, t: -, l: 0) {{(pid=189076) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:06:05.505180 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5 due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:06:05.505357 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:06:05.505564 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] VM Started (Lifecycle Event) Jan 26 19:06:05.507826 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host3/scan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:05.529348 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host3/scan" returned: 0 in 0.024s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:05.529348 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab95eefd-ab78-44ea-9efb-266f117ceeac]: (4, ('- - 0', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:05.529755 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching for a device in session 9 and hctl ['3', '*', '*', 0] yield: None {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:06:05.558812 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-0834d6d5-28ed-41c6-be9f-b1fcb6acd169 req-f90db23c-fffd-423b-b086-b4566eec2190 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received event network-vif-plugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:06:05.559051 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-0834d6d5-28ed-41c6-be9f-b1fcb6acd169 req-f90db23c-fffd-423b-b086-b4566eec2190 service nova] Acquiring lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:05.559278 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-0834d6d5-28ed-41c6-be9f-b1fcb6acd169 req-f90db23c-fffd-423b-b086-b4566eec2190 service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:05.559474 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-0834d6d5-28ed-41c6-be9f-b1fcb6acd169 req-f90db23c-fffd-423b-b086-b4566eec2190 service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:05.559657 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-0834d6d5-28ed-41c6-be9f-b1fcb6acd169 req-f90db23c-fffd-423b-b086-b4566eec2190 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Processing event network-vif-plugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:06:05.564393 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:06:05.578308 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Instance running successfully. Jan 26 19:06:05.578308 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] finish_revert_migration finished successfully. {{(pid=189076) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12857}} Jan 26 19:06:05.658557 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:05.661700 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:05.663504 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:05.668568 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:06.008843 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:06:06.011675 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:06:06.330507 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:06:06.332129 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:06:06.332563 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Creating image(s) Jan 26 19:06:06.333331 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:06.333607 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "/opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:06.334512 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "/opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:06.335472 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:06:06.344461 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:06:06.348548 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:06.424162 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.078s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:06.424539 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:06.425093 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:06.425967 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:06:06.431069 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:06:06.431537 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:06.514670 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] During sync_power_state the instance has a pending task (resize_reverting). Skip. Jan 26 19:06:06.515164 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:06:06.515348 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] VM Paused (Lifecycle Event) Jan 26 19:06:06.520819 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.086s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:06.520819 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:06.530883 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching for a device in session 9 and hctl ['3', '*', '*', 0] yield: sdb {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:06:06.531343 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Connected to sdb using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'target_lun': 0, 'volume_id': '8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'auth_method': 'CHAP', 'auth_username': 'DJGdCSYcXoX7W45zGsrh', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True} {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:06:06.531920 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.179s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:06:06.532106 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] <== connect_volume: return (2180ms) {'type': 'block', 'scsi_wwn': '360014051a650fe7ac354c5cb11a9454f', 'path': '/dev/sdb'} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:06:06.532502 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '360014051a650fe7ac354c5cb11a9454f', 'path': '/dev/sdb'} {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jan 26 19:06:06.535918 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'flavor' on Instance uuid c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:06:06.548038 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk 1073741824" returned: 0 in 0.030s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:06.548262 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.123s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:06.548542 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:06.596558 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-39f95a65-2028-4b24-b8cc-9ff7cd5ea3b8 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Updating instance to original state: 'active' Jan 26 19:06:06.619019 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.070s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:06.622016 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:06:06.622016 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:06.632856 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-55c4c7bc-c00c-4e5e-bab5-28c467e1b0ba tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "e6131b49-ccfa-43e4-9480-76d9062c4e48" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 9.517s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:06.702474 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:06.702935 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Cannot resize image /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:06:06.703391 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:06:06.703650 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Ensure instance console log exists: /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:06:06.704278 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:06.704569 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:06.704865 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:06.707686 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Start _get_guest_xml network_info=[] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:06:06.713642 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:06:06.715277 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerShowV254Test-server-1844040446', uuid='2f9056ef-40b7-40df-8a63-d2328ad5987e'), owner=OwnerMeta(userid='b056281cfdec4693b392da5fb2f200a2', username='tempest-ServerShowV254Test-851494845-project-member', projectid='e942ff215aa04477b2315d664f85e209', projectname='tempest-ServerShowV254Test-851494845'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[], nova_package='32.1.0', creation_time=1769472366.7148297) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:06:06.716678 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:06:06.717190 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:06:06.719109 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:06:06.719570 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:06:06.720722 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:06:06.721197 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:06:06.721431 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:06:06.721629 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:06:06.721949 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:06:06.722130 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:06:06.722292 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:06:06.722550 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:06:06.722761 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:06:06.723099 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:06:06.723599 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:06:06.723833 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:06:06.728166 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f9056ef-40b7-40df-8a63-d2328ad5987e {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:06:07.011056 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:07.019492 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:06:07.022940 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:06:07.023155 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] VM Resumed (Lifecycle Event) Jan 26 19:06:07.043009 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] attach device xml: Jan 26 19:06:07.043009 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.043009 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.043009 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.043009 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.043009 np0005596550.novalocal nova-compute[189076]: 8ca88aff-367a-4ce7-9a74-4ca46af97c3f Jan 26 19:06:07.043009 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.043009 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:330}} Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] End _get_guest_xml xml= Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: 2f9056ef-40b7-40df-8a63-d2328ad5987e Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: instance-00000047 Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: tempest-ServerShowV254Test-server-1844040446 Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:06:06 Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: tempest-ServerShowV254Test-851494845-project-member Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: tempest-ServerShowV254Test-851494845 Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: 2f9056ef-40b7-40df-8a63-d2328ad5987e Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: 2f9056ef-40b7-40df-8a63-d2328ad5987e Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:07.232131 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:06:07.527783 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:06:07.532172 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:06:07.587723 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ef9fc498-11a8-468a-9e24-377e6476a33f req-0ba4eee5-8b0f-4ff0-951a-c4bb7713578a service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received event network-vif-plugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:06:07.588009 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ef9fc498-11a8-468a-9e24-377e6476a33f req-0ba4eee5-8b0f-4ff0-951a-c4bb7713578a service nova] Acquiring lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:07.588268 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ef9fc498-11a8-468a-9e24-377e6476a33f req-0ba4eee5-8b0f-4ff0-951a-c4bb7713578a service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:07.588462 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ef9fc498-11a8-468a-9e24-377e6476a33f req-0ba4eee5-8b0f-4ff0-951a-c4bb7713578a service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:07.588662 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ef9fc498-11a8-468a-9e24-377e6476a33f req-0ba4eee5-8b0f-4ff0-951a-c4bb7713578a service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] No waiting events found dispatching network-vif-plugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:06:07.588899 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-ef9fc498-11a8-468a-9e24-377e6476a33f req-0ba4eee5-8b0f-4ff0-951a-c4bb7713578a service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received unexpected event network-vif-plugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 for instance with vm_state active and task_state None. Jan 26 19:06:08.527963 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8f40a91d-f415-4429-aa79-49a05b263602 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:08.528345 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8f40a91d-f415-4429-aa79-49a05b263602 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:08.528450 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8f40a91d-f415-4429-aa79-49a05b263602 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:08.528692 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8f40a91d-f415-4429-aa79-49a05b263602 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:08.528911 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8f40a91d-f415-4429-aa79-49a05b263602 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:08.531551 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-8f40a91d-f415-4429-aa79-49a05b263602 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Terminating instance Jan 26 19:06:08.627500 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:06:08.627670 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No BDM found with device name vdb, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:06:08.627750 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:06:08.627892 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No VIF found with MAC fa:16:3e:5b:de:3a, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:06:08.755777 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:06:08.755907 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:06:08.756365 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Using config drive Jan 26 19:06:09.035193 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-8f40a91d-f415-4429-aa79-49a05b263602 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:06:09.117868 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:09.138438 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:09.148154 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:09.266221 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:09.312187 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Instance destroyed successfully. Jan 26 19:06:09.313738 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-8f40a91d-f415-4429-aa79-49a05b263602 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'resources' on Instance uuid 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:06:09.336848 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Creating config drive at /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk.config Jan 26 19:06:09.340213 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp5wn7o8lt {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:09.462838 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp5wn7o8lt" returned: 0 in 0.122s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:09.643513 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d3fc502b-3093-43db-8fbd-3e7bcbac20dd req-01303a03-03b0-4d89-82b8-d44374c0327b service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received event network-vif-unplugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:06:09.644061 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d3fc502b-3093-43db-8fbd-3e7bcbac20dd req-01303a03-03b0-4d89-82b8-d44374c0327b service nova] Acquiring lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:09.644091 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d3fc502b-3093-43db-8fbd-3e7bcbac20dd req-01303a03-03b0-4d89-82b8-d44374c0327b service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:09.644340 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d3fc502b-3093-43db-8fbd-3e7bcbac20dd req-01303a03-03b0-4d89-82b8-d44374c0327b service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:09.644503 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d3fc502b-3093-43db-8fbd-3e7bcbac20dd req-01303a03-03b0-4d89-82b8-d44374c0327b service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] No waiting events found dispatching network-vif-unplugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:06:09.644719 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d3fc502b-3093-43db-8fbd-3e7bcbac20dd req-01303a03-03b0-4d89-82b8-d44374c0327b service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received event network-vif-unplugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:06:09.644928 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d3fc502b-3093-43db-8fbd-3e7bcbac20dd req-01303a03-03b0-4d89-82b8-d44374c0327b service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received event network-vif-unplugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:06:09.645130 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d3fc502b-3093-43db-8fbd-3e7bcbac20dd req-01303a03-03b0-4d89-82b8-d44374c0327b service nova] Acquiring lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:09.645331 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d3fc502b-3093-43db-8fbd-3e7bcbac20dd req-01303a03-03b0-4d89-82b8-d44374c0327b service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:09.645502 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d3fc502b-3093-43db-8fbd-3e7bcbac20dd req-01303a03-03b0-4d89-82b8-d44374c0327b service nova] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:09.645679 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d3fc502b-3093-43db-8fbd-3e7bcbac20dd req-01303a03-03b0-4d89-82b8-d44374c0327b service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] No waiting events found dispatching network-vif-unplugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:06:09.645894 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d3fc502b-3093-43db-8fbd-3e7bcbac20dd req-01303a03-03b0-4d89-82b8-d44374c0327b service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received event network-vif-unplugged-fe2a5eb1-3745-4099-b530-b2e55ec11296 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:06:09.652430 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Instance event wait completed in 0 seconds for {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:06:09.652710 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:06:09.653615 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:06:09.654100 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] VM Resumed (Lifecycle Event) Jan 26 19:06:09.659373 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Instance spawned successfully. Jan 26 19:06:09.663219 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:06:09.817372 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-8f40a91d-f415-4429-aa79-49a05b263602 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-469643394',display_name='tempest-ServerActionsTestJSON-server-469643394',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestjson-server-469643394',id=67,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaqJcAWtBvnDQt3Z0Zs2SEk8GmS4qswJn8I3pLNnZ26AiUp6izAb2VATu7Ta6RkUjooYd/ncwVnO6h5/K851Ht4DSyJ8eVOthZpoT3zQfgSsI2MjV6hMkI8XyrAdvV6PQ==',key_name='tempest-keypair-571396453',keypairs=,launch_index=0,launched_at=2026-01-27T00:06:06Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-v7nt6kx2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:06:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=48ff5e37-56fe-46a8-b14c-8e4cf3197fb5,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:06:09.817679 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-8f40a91d-f415-4429-aa79-49a05b263602 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "address": "fa:16:3e:9b:fd:69", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2a5eb1-37", "ovs_interfaceid": "fe2a5eb1-3745-4099-b530-b2e55ec11296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:06:09.818314 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-8f40a91d-f415-4429-aa79-49a05b263602 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:69,bridge_name='br-int',has_traffic_filtering=True,id=fe2a5eb1-3745-4099-b530-b2e55ec11296,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2a5eb1-37') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:06:09.818545 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-8f40a91d-f415-4429-aa79-49a05b263602 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:69,bridge_name='br-int',has_traffic_filtering=True,id=fe2a5eb1-3745-4099-b530-b2e55ec11296,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2a5eb1-37') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:06:09.819672 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:09.819952 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe2a5eb1-37, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:06:09.821246 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:09.822548 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:09.823329 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:09.823500 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6898e3c7-4835-41ff-af31-416c93eefba6) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:06:09.824000 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:09.824982 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:09.826567 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-8f40a91d-f415-4429-aa79-49a05b263602 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:69,bridge_name='br-int',has_traffic_filtering=True,id=fe2a5eb1-3745-4099-b530-b2e55ec11296,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2a5eb1-37') Jan 26 19:06:09.826848 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-8f40a91d-f415-4429-aa79-49a05b263602 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Deleting instance files /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5_del Jan 26 19:06:09.827310 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-8f40a91d-f415-4429-aa79-49a05b263602 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Deletion of /opt/stack/data/nova/instances/48ff5e37-56fe-46a8-b14c-8e4cf3197fb5_del complete Jan 26 19:06:10.157670 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:06:10.160955 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:06:10.201437 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:06:10.201437 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:06:10.201563 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] VM Started (Lifecycle Event) Jan 26 19:06:10.210911 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:06:10.210911 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:06:10.211293 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:06:10.211651 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:06:10.212020 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:06:10.212254 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:06:10.214816 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e9d71022-09b2-4ace-865f-500962c4f7d6 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 9.510s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:10.336532 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-8f40a91d-f415-4429-aa79-49a05b263602 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Took 1.30 seconds to destroy the instance on the hypervisor. Jan 26 19:06:10.336876 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-8f40a91d-f415-4429-aa79-49a05b263602 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:06:10.336984 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:06:10.337057 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:06:10.337367 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:10.464514 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:10.716472 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:06:10.719616 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Took 4.39 seconds to spawn the instance on the hypervisor. Jan 26 19:06:10.719828 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:06:10.726463 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:06:10.912102 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:10.974789 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-446204ad-5a39-4e3a-a4ed-c42cfd3ddeb7 req-c45090e9-94cc-4c01-a65f-169d50608ea5 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Received event network-vif-deleted-fe2a5eb1-3745-4099-b530-b2e55ec11296 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:06:10.974789 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-446204ad-5a39-4e3a-a4ed-c42cfd3ddeb7 req-c45090e9-94cc-4c01-a65f-169d50608ea5 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Neutron deleted interface fe2a5eb1-3745-4099-b530-b2e55ec11296; detaching it from the instance and deleting it from the info cache Jan 26 19:06:10.974789 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-446204ad-5a39-4e3a-a4ed-c42cfd3ddeb7 req-c45090e9-94cc-4c01-a65f-169d50608ea5 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:06:11.232313 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:06:11.240327 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Took 11.69 seconds to build instance. Jan 26 19:06:11.449647 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:06:11.482482 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-446204ad-5a39-4e3a-a4ed-c42cfd3ddeb7 req-c45090e9-94cc-4c01-a65f-169d50608ea5 service nova] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Detach interface failed, port_id=fe2a5eb1-3745-4099-b530-b2e55ec11296, reason: Instance 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5 could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:06:11.743138 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e699cd48-baa1-4cda-b997-27b4435328f8 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "2f9056ef-40b7-40df-8a63-d2328ad5987e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 13.197s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:11.954401 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Took 1.62 seconds to deallocate network for instance. Jan 26 19:06:12.235775 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Stashing vm_state: active {{(pid=189076) _prep_resize /opt/stack/nova/nova/compute/manager.py:6217}} Jan 26 19:06:12.475944 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8f40a91d-f415-4429-aa79-49a05b263602 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:12.476103 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8f40a91d-f415-4429-aa79-49a05b263602 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:12.477229 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8f40a91d-f415-4429-aa79-49a05b263602 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:12.520377 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-8f40a91d-f415-4429-aa79-49a05b263602 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Deleted allocations for instance 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5 Jan 26 19:06:12.568575 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Rebuilding instance Jan 26 19:06:12.669394 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:06:12.781455 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:12.781892 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:12.895473 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:06:12.895740 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:06:13.293522 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:06:13.293840 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Claim successful on node np0005596550.novalocal Jan 26 19:06:13.401298 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:13.538670 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8f40a91d-f415-4429-aa79-49a05b263602 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "48ff5e37-56fe-46a8-b14c-8e4cf3197fb5" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 5.010s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:13.806292 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.resource_tracker [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Updating resource usage from migration 314fc02f-7ffc-4f6d-af22-19ef9899c3b8 Jan 26 19:06:13.932792 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Instance destroyed successfully. Jan 26 19:06:13.938068 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Instance destroyed successfully. Jan 26 19:06:13.938504 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Deleting instance files /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e_del Jan 26 19:06:13.939054 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Deletion of /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e_del complete Jan 26 19:06:14.000223 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:06:14.504373 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:06:14.855356 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:15.010896 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.229s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:15.010896 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Migrating Jan 26 19:06:15.016284 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.615s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:15.016431 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:15.016564 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:06:15.187034 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "15a722c1-acc4-4b55-be3b-4f339ef40d15" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:15.187341 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:15.458883 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:06:15.459207 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Creating image(s) Jan 26 19:06:15.459678 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:15.459988 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "/opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:15.460539 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "/opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:15.461094 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:06:15.464347 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:06:15.465582 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:15.525715 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "refresh_cache-c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:06:15.525901 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquired lock "refresh_cache-c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:06:15.526076 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:06:15.561092 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json" returned: 0 in 0.095s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:15.561351 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Acquiring lock "791283f4306f6266c365d052f132d740f0c9b85f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:15.561677 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "791283f4306f6266c365d052f132d740f0c9b85f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:15.562713 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:06:15.566036 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:06:15.566354 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:15.642741 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json" returned: 0 in 0.076s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:15.643176 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f,backing_fmt=raw /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:15.681064 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f,backing_fmt=raw /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk 1073741824" returned: 0 in 0.038s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:15.681371 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "791283f4306f6266c365d052f132d740f0c9b85f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.120s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:15.681626 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:15.690286 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:06:15.744421 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json" returned: 0 in 0.063s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:15.744673 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:06:15.744897 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:15.778451 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "e6131b49-ccfa-43e4-9480-76d9062c4e48" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:15.778695 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "e6131b49-ccfa-43e4-9480-76d9062c4e48" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:15.829250 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:15.829463 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Cannot resize image /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:06:15.829835 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:06:15.830013 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Ensure instance console log exists: /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:06:15.830308 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:15.830551 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:15.830730 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:15.831862 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Start _get_guest_xml network_info=[] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-01-26T23:49:28Z,direct_url=,disk_format='qcow2',id=bd70f82e-84e0-4042-ad07-7b834bb8ac38,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-01-26T23:49:31Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:06:15.837655 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError Jan 26 19:06:15.839385 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bd70f82e-84e0-4042-ad07-7b834bb8ac38', instance_meta=NovaInstanceMeta(name='tempest-ServerShowV254Test-server-1844040446', uuid='2f9056ef-40b7-40df-8a63-d2328ad5987e'), owner=OwnerMeta(userid='b056281cfdec4693b392da5fb2f200a2', username='tempest-ServerShowV254Test-851494845-project-member', projectid='e942ff215aa04477b2315d664f85e209', projectname='tempest-ServerShowV254Test-851494845'), image=ImageMeta(id='bd70f82e-84e0-4042-ad07-7b834bb8ac38', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[], nova_package='32.1.0', creation_time=1769472375.83889) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:06:15.840843 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:06:15.841213 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:06:15.842574 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:06:15.842952 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:06:15.843931 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:06:15.844269 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-01-26T23:49:28Z,direct_url=,disk_format='qcow2',id=bd70f82e-84e0-4042-ad07-7b834bb8ac38,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-01-26T23:49:31Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:06:15.844493 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:06:15.844651 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:06:15.844801 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:06:15.844928 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:06:15.845051 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:06:15.845255 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:06:15.845391 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:06:15.845563 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:06:15.845733 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:06:15.846046 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:06:15.846274 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2f9056ef-40b7-40df-8a63-d2328ad5987e {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:06:15.882784 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "e6131b49-ccfa-43e4-9480-76d9062c4e48" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:16.032034 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:16.058804 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:16.142760 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:16.142760 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:16.231654 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:16.231894 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:16.233464 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:16.233687 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=189076) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12209}} Jan 26 19:06:16.236541 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:06:16.236705 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Claim successful on node np0005596550.novalocal Jan 26 19:06:16.242952 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:16.256699 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:16.283479 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Detaching volume fc88f51d-d7b1-4097-802e-4391470eeab1 Jan 26 19:06:16.324141 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.block_device [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Attempting to driver detach volume fc88f51d-d7b1-4097-802e-4391470eeab1 from mountpoint /dev/vdb Jan 26 19:06:16.342152 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:16.342582 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] End _get_guest_xml xml= Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: 2f9056ef-40b7-40df-8a63-d2328ad5987e Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: instance-00000047 Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: tempest-ServerShowV254Test-server-1844040446 Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:06:15 Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: tempest-ServerShowV254Test-851494845-project-member Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: tempest-ServerShowV254Test-851494845 Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: 2f9056ef-40b7-40df-8a63-d2328ad5987e Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: 2f9056ef-40b7-40df-8a63-d2328ad5987e Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.361210 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:06:16.375385 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Found disk vdb by alias ua-fc88f51d-d7b1-4097-802e-4391470eeab1 {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:06:16.376263 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Found disk vdb by alias ua-fc88f51d-d7b1-4097-802e-4391470eeab1 {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:06:16.376425 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Attempting to detach device vdb from instance e6131b49-ccfa-43e4-9480-76d9062c4e48 from the persistent domain config. {{(pid=189076) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2599}} Jan 26 19:06:16.376703 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] detach device xml: Jan 26 19:06:16.376703 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.376703 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.376703 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.376703 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.376703 np0005596550.novalocal nova-compute[189076]: fc88f51d-d7b1-4097-802e-4391470eeab1 Jan 26 19:06:16.376703 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:06:16.376703 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.376703 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:06:16.386202 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Found disk vdb by alias ua-fc88f51d-d7b1-4097-802e-4391470eeab1 {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:06:16.386419 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Failed to detach device vdb from instance e6131b49-ccfa-43e4-9480-76d9062c4e48 from the persistent domain config. Libvirt did not report any error but the device is still in the config. Jan 26 19:06:16.386655 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] (1/8): Attempting to detach device vdb with device alias ua-fc88f51d-d7b1-4097-802e-4391470eeab1 from instance e6131b49-ccfa-43e4-9480-76d9062c4e48 from the live domain config. {{(pid=189076) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2633}} Jan 26 19:06:16.387041 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] detach device xml: Jan 26 19:06:16.387041 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.387041 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.387041 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.387041 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.387041 np0005596550.novalocal nova-compute[189076]: fc88f51d-d7b1-4097-802e-4391470eeab1 Jan 26 19:06:16.387041 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:06:16.387041 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:16.387041 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:06:16.390231 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Updating instance_info_cache with network_info: [{"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:06:16.428635 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:16.506833 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Received event ua-fc88f51d-d7b1-4097-802e-4391470eeab1> from libvirt while the driver is waiting for it; dispatched. {{(pid=189076) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2486}} Jan 26 19:06:16.508434 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-fc88f51d-d7b1-4097-802e-4391470eeab1 for instance e6131b49-ccfa-43e4-9480-76d9062c4e48 {{(pid=189076) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2713}} Jan 26 19:06:16.511440 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6131b49-ccfa-43e4-9480-76d9062c4e48/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:16.520744 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Successfully detached device vdb from instance e6131b49-ccfa-43e4-9480-76d9062c4e48 from the live domain config. Jan 26 19:06:16.522671 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] calling os-brick to detach iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jan 26 19:06:16.523540 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1', 'target_lun': 0, 'volume_id': 'fc88f51d-d7b1-4097-802e-4391470eeab1', 'auth_method': 'CHAP', 'auth_username': 'AqXp2jypWCEhwN2JacNe', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sda'}, None), 'kwargs': False}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:06:16.523732 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:06:16.524277 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:06:16.525383 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:16.535505 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:16.537205 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5bccb6-74df-40ff-864c-b8375f25f2ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:16.537508 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:06:16.537508 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:06:16.537508 np0005596550.novalocal nova-compute[189076]: iSNS: Jan 26 19:06:16.537508 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:06:16.537508 np0005596550.novalocal nova-compute[189076]: STATIC: Jan 26 19:06:16.537508 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 Jan 26 19:06:16.537508 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:06:16.537508 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:06:16.537508 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f Jan 26 19:06:16.537508 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:06:16.537508 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:06:16.537508 np0005596550.novalocal nova-compute[189076]: FIRMWARE: Jan 26 19:06:16.537508 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:06:16.537508 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:06:16.537758 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:06:16.537758 np0005596550.novalocal nova-compute[189076]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:06:16.537758 np0005596550.novalocal nova-compute[189076]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=189076) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:06:16.537879 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1', 0)] {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:06:16.538439 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:16.547988 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:16.548198 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab12aaa-0634-432a-9a96-a1b0e9728040]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f\n38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:16.549150 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:16.560577 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:16.562173 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee00a98-c870-4fce-9179-eb7c4234f9f0]: (4, ('tcp: [8] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 (non-flash)\ntcp: [9] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:16.562503 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 (non-flash) Jan 26 19:06:16.562503 np0005596550.novalocal nova-compute[189076]: tcp: [9] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f (non-flash) Jan 26 19:06:16.562503 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:06:16.562698 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsi session list stdout=tcp: [8] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 (non-flash) Jan 26 19:06:16.562698 np0005596550.novalocal nova-compute[189076]: tcp: [9] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f (non-flash) Jan 26 19:06:16.562698 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:06:16.563350 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Resulting device map defaultdict(. at 0x7fd768185440>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1'): ({'sda'}, set())}) {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:06:16.563567 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Removing single pathed devices sda {{(pid=189076) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:06:16.564134 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:16.571573 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:06:16.572640 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[6ba3f432-52ab-4bc4-bb47-0cc3216a50cf]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:06:16.572640 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:06:16.572640 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:06:16.572640 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:06:16.572640 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:16.572640 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:06:16.572640 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:06:16.572640 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:16.572640 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:06:16.572640 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:06:16.572640 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:16.572640 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:06:16.572640 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:06:16.572640 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:16.572640 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:06:16.572640 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:06:16.572640 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:16.572640 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:06:16.572640 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:06:16.572640 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:06:16.572640 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:06:16.572640 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:06:16.573598 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba3f432-52ab-4bc4-bb47-0cc3216a50cf]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:16.574207 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Flushing IO for device /dev/sda {{(pid=189076) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:06:16.574825 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sda {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:16.582429 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sda" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:16.582596 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b522eea-152c-4b73-9217-1d8a5df7c04b]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:16.582932 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Remove SCSI device /dev/sda with /sys/block/sda/device/delete {{(pid=189076) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:06:16.583405 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sda/device/delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:16.600979 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6131b49-ccfa-43e4-9480-76d9062c4e48/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:16.604431 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6131b49-ccfa-43e4-9480-76d9062c4e48/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:16.638491 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sda/device/delete" returned: 0 in 0.055s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:16.638638 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[3581b653-c5e6-4067-afd9-a036e3a6ee87]: (4, ('1', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:16.639119 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Checking to see if SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:06:16.639281 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:06:16.639602 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1')] {{(pid=189076) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:06:16.640116 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:16.654408 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.014s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:16.654698 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b3cca1-13b2-4ada-9725-b59adaa48f66]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:16.655209 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:16.655898 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260 --logout {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:16.686443 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260 --logout" returned: 0 in 0.030s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:16.686626 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eba5f7a-15ba-468b-b3bb-b595bb0a4d8a]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1, portal: 38.102.83.18,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:16.686995 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1, portal: 38.102.83.18,3260] Jan 26 19:06:16.686995 np0005596550.novalocal nova-compute[189076]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1, portal: 38.102.83.18,3260] successful. Jan 26 19:06:16.686995 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:16.687549 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260 --op delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:16.688446 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6131b49-ccfa-43e4-9480-76d9062c4e48/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:16.696593 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1 -p 38.102.83.18:3260 --op delete" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:16.696753 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22dde4b-7102-4e0d-ae12-a41b85fed5ed]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:16.697124 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:16.697485 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.173s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:06:16.697706 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] <== disconnect_volume: return (173ms) None {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:06:16.697965 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Disconnected iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jan 26 19:06:16.837007 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:06:16.837850 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:16.853008 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.015s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:16.853268 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=7017MB free_disk=373.36622619628906GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:06:16.853395 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:16.892892 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Releasing lock "refresh_cache-c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:06:17.494897 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:06:17.891982 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:06:17.893376 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:06:17.893376 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Using config drive Jan 26 19:06:17.997743 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:06:18.396764 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lazy-loading 'ec2_ids' on Instance uuid 2f9056ef-40b7-40df-8a63-d2328ad5987e {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:06:18.410453 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Starting migrate_disk_and_power_off {{(pid=189076) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12481}} Jan 26 19:06:18.434832 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:18.436491 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:18.441729 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:18.503553 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.271s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:18.503705 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:06:18.507028 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.654s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:18.579895 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7d6a48a6-6841-4dcb-aca7-67ca73c96dcd req-03eacc2b-ea58-4db0-acbb-8e7972b58bac service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received event network-vif-unplugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:06:18.580142 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7d6a48a6-6841-4dcb-aca7-67ca73c96dcd req-03eacc2b-ea58-4db0-acbb-8e7972b58bac service nova] Acquiring lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:18.580397 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7d6a48a6-6841-4dcb-aca7-67ca73c96dcd req-03eacc2b-ea58-4db0-acbb-8e7972b58bac service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:18.580578 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7d6a48a6-6841-4dcb-aca7-67ca73c96dcd req-03eacc2b-ea58-4db0-acbb-8e7972b58bac service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:18.581343 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7d6a48a6-6841-4dcb-aca7-67ca73c96dcd req-03eacc2b-ea58-4db0-acbb-8e7972b58bac service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] No waiting events found dispatching network-vif-unplugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:06:18.581840 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-7d6a48a6-6841-4dcb-aca7-67ca73c96dcd req-03eacc2b-ea58-4db0-acbb-8e7972b58bac service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received unexpected event network-vif-unplugged-0c5d371a-1c65-41be-864a-81be5995c568 for instance with vm_state active and task_state resize_migrating. Jan 26 19:06:18.620240 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:18.627993 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:18.661809 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:18.666874 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:18.742883 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Instance destroyed successfully. Jan 26 19:06:18.743973 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:05:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1924433663',display_name='tempest-ServerActionsTestOtherB-server-1924433663',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-1924433663',id=68,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK72/fZgFXc8Nm23qFp5bqxu5uQWjdqvi6tf0S8eHH5LAOejrjAG2pg3k7mvst6GtMR5cAEv++XPpoBWMRpc6kXyw3lb+Uukjxykolyr/SPF2WcEU8zRsEYayUYxi/WyQ==',key_name='tempest-keypair-56259378',keypairs=,launch_index=0,launched_at=2026-01-27T00:05:28Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-i9xjjhbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-630226605-network", "vif_mac": "fa:16:3e:5b:de:3a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:06:18.744213 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-630226605-network", "vif_mac": "fa:16:3e:5b:de:3a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:06:18.744957 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:de:3a,bridge_name='br-int',has_traffic_filtering=True,id=0c5d371a-1c65-41be-864a-81be5995c568,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5d371a-1c') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:06:18.745258 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:de:3a,bridge_name='br-int',has_traffic_filtering=True,id=0c5d371a-1c65-41be-864a-81be5995c568,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5d371a-1c') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:06:18.746580 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:18.746874 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c5d371a-1c, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:06:18.749623 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:18.750542 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:18.750818 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9876ee3c-6bc9-44de-bf4b-f4b622b5f15a) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:06:18.752932 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:18.755353 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:de:3a,bridge_name='br-int',has_traffic_filtering=True,id=0c5d371a-1c65-41be-864a-81be5995c568,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5d371a-1c') Jan 26 19:06:18.756833 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] calling os-brick to detach iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jan 26 19:06:18.757441 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'target_lun': 0, 'volume_id': '8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'auth_method': 'CHAP', 'auth_username': 'DJGdCSYcXoX7W45zGsrh', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:06:18.757611 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:06:18.757972 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:06:18.759037 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:18.768853 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:18.768962 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[2445f02f-c6a6-4841-b8bc-2bf3632d1696]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:18.769246 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:06:18.769246 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:06:18.769246 np0005596550.novalocal nova-compute[189076]: iSNS: Jan 26 19:06:18.769246 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:06:18.769246 np0005596550.novalocal nova-compute[189076]: STATIC: Jan 26 19:06:18.769246 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f Jan 26 19:06:18.769246 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:06:18.769246 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:06:18.769246 np0005596550.novalocal nova-compute[189076]: FIRMWARE: Jan 26 19:06:18.769246 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:06:18.769246 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:06:18.769388 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:06:18.769388 np0005596550.novalocal nova-compute[189076]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:06:18.769388 np0005596550.novalocal nova-compute[189076]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=189076) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:06:18.769574 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 0)] {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:06:18.770355 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:18.780965 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:18.781140 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c151c77-e825-4d53-9780-1a6cec9426e8]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:18.782054 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:18.792673 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:18.792848 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fab1202-304e-427b-acf8-49fb535a6ed4]: (4, ('tcp: [9] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:18.793196 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f (non-flash) Jan 26 19:06:18.793196 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:06:18.793347 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsi session list stdout=tcp: [9] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f (non-flash) Jan 26 19:06:18.793347 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:06:18.793869 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Resulting device map defaultdict(. at 0x7fd72c362ac0>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f'): ({'sdb'}, set())}) {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:06:18.794163 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Removing single pathed devices sdb {{(pid=189076) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:06:18.795131 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:18.801763 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:06:18.803326 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[610daf94-1efb-47d7-afae-09ec666b5154]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:06:18.803326 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:06:18.803326 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:06:18.803326 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:06:18.803326 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:18.803326 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:06:18.803326 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:06:18.803326 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:18.803326 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:06:18.803326 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:06:18.803326 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:18.803326 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:06:18.803326 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:06:18.803326 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:18.803326 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:06:18.803326 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:06:18.803326 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:18.803326 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:06:18.803326 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:06:18.803326 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:06:18.803326 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:06:18.803326 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:06:18.804551 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[610daf94-1efb-47d7-afae-09ec666b5154]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:18.805037 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Flushing IO for device /dev/sdb {{(pid=189076) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:06:18.805653 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:18.810822 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.005s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:18.810960 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee73b8e6-082c-4f23-ab45-ff4b353e042c]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:18.811274 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=189076) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:06:18.811938 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:18.874415 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:18.874687 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[103ec10c-30f4-41df-a835-b6961c28995a]: (4, ('1', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:18.875335 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:06:18.875715 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] SCSI volumes sdb have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:06:18.876346 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f')] {{(pid=189076) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:06:18.878871 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:18.888529 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:18.888750 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[5600836a-f5fb-4c99-8d9c-fa938270d2cd]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:18.889279 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:18.890493 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --logout {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:18.901287 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Object Instance<2f9056ef-40b7-40df-8a63-d2328ad5987e> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:06:18.905418 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError Jan 26 19:06:18.925651 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --logout" returned: 0 in 0.028s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:18.925827 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd427eda-8c91-4a9b-a95f-8e20f65f7aa2]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f, portal: 38.102.83.18,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:18.926230 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f, portal: 38.102.83.18,3260] Jan 26 19:06:18.926230 np0005596550.novalocal nova-compute[189076]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f, portal: 38.102.83.18,3260] successful. Jan 26 19:06:18.926230 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:18.926958 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:18.939729 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op delete" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:18.941979 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[691bc546-9faf-4a77-ae3a-b9fac68dc6a6]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:18.942306 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:18.942621 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.185s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:06:18.942860 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] <== disconnect_volume: return (185ms) None {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:06:18.943056 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Disconnected iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jan 26 19:06:18.949671 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:18.975009 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Creating config drive at /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk.config Jan 26 19:06:18.980692 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpvhtr63of {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:19.016537 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:06:19.016684 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:06:19.017072 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:19.017309 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:19.044313 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:19.044583 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:19.082108 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25c3c9ca754941ccbd986028c2a87e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efcb8570b994820a5956fab4e859054', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:06:19.102501 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpvhtr63of" returned: 0 in 0.122s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:19.129580 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:19.130038 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=189076) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12209}} Jan 26 19:06:19.131752 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6_resize/disk /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:19.162274 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "cp -r /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6_resize/disk /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk" returned: 0 in 0.031s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:19.162852 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6_resize/disk.config /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk.config {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:19.187243 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "cp -r /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6_resize/disk.config /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk.config" returned: 0 in 0.021s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:19.187243 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6_resize/disk.info /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk.info {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:19.206734 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "cp -r /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6_resize/disk.info /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk.info" returned: 0 in 0.021s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:19.330088 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Instance event wait completed in 0 seconds for {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:06:19.330479 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:06:19.331135 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for 2f9056ef-40b7-40df-8a63-d2328ad5987e due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:06:19.331451 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:06:19.331761 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] VM Resumed (Lifecycle Event) Jan 26 19:06:19.339942 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Instance spawned successfully. Jan 26 19:06:19.340487 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:06:19.529665 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:06:19.541373 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Applying migration context for instance c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6 as it has an incoming, in-progress migration 314fc02f-7ffc-4f6d-af22-19ef9899c3b8. Migration status is migrating {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}} Jan 26 19:06:19.542543 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Updating resource usage from migration 314fc02f-7ffc-4f6d-af22-19ef9899c3b8 Jan 26 19:06:19.591184 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance d0ddb554-76ed-49a6-a02b-042680eb310d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:06:19.591184 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance e6131b49-ccfa-43e4-9480-76d9062c4e48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:06:19.591734 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 2f9056ef-40b7-40df-8a63-d2328ad5987e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:06:19.592311 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Migration 314fc02f-7ffc-4f6d-af22-19ef9899c3b8 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}} Jan 26 19:06:19.592859 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:06:19.593272 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 15a722c1-acc4-4b55-be3b-4f339ef40d15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:06:19.593743 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 6 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:06:19.594090 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=1728MB phys_disk=399GB used_disk=6GB total_vcpus=8 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:06:16 up 34 min, 14 users, load average: 4.70, 4.96, 3.70\n', 'num_instances': '5', 'num_vm_active': '4', 'num_task_None': '2', 'num_os_type_None': '5', 'num_proj_8428b9d1e48c42f690612bf1e012ec42': '2', 'io_workload': '2', 'num_task_resize_migrating': '1', 'num_task_deleting': '1', 'num_proj_c55032abafa74d4facac03929da4a366': '1', 'num_task_rebuild_spawning': '1', 'num_proj_e942ff215aa04477b2315d664f85e209': '1', 'num_vm_building': '1', 'num_proj_2efcb8570b994820a5956fab4e859054': '1'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:06:19.646495 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Successfully created port: 5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:06:19.812811 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:06:19.837584 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:06:19.846759 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:06:19.852091 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:06:19.852091 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:06:19.852641 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:06:19.853041 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:06:19.853800 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:06:19.853800 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:06:20.038033 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:06:20.098146 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Successfully updated port: 5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:06:20.257744 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lazy-loading 'flavor' on Instance uuid e6131b49-ccfa-43e4-9480-76d9062c4e48 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:06:20.324985 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:06:20.352726 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] During sync_power_state the instance has a pending task (rebuild_spawning). Skip. Jan 26 19:06:20.352726 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:06:20.353515 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] VM Started (Lifecycle Event) Jan 26 19:06:20.360647 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:06:20.603497 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "refresh_cache-15a722c1-acc4-4b55-be3b-4f339ef40d15" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:06:20.603791 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquired lock "refresh_cache-15a722c1-acc4-4b55-be3b-4f339ef40d15" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:06:20.604085 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:06:20.623467 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3aa52a8e-b2b1-43e7-8490-ae84bf437c9c req-83bfbe81-e854-4e84-aef7-7984be30a9d3 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received event network-vif-unplugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:06:20.627359 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3aa52a8e-b2b1-43e7-8490-ae84bf437c9c req-83bfbe81-e854-4e84-aef7-7984be30a9d3 service nova] Acquiring lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:20.627359 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3aa52a8e-b2b1-43e7-8490-ae84bf437c9c req-83bfbe81-e854-4e84-aef7-7984be30a9d3 service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:20.628075 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3aa52a8e-b2b1-43e7-8490-ae84bf437c9c req-83bfbe81-e854-4e84-aef7-7984be30a9d3 service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:20.628406 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3aa52a8e-b2b1-43e7-8490-ae84bf437c9c req-83bfbe81-e854-4e84-aef7-7984be30a9d3 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] No waiting events found dispatching network-vif-unplugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:06:20.628737 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-3aa52a8e-b2b1-43e7-8490-ae84bf437c9c req-83bfbe81-e854-4e84-aef7-7984be30a9d3 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received unexpected event network-vif-unplugged-0c5d371a-1c65-41be-864a-81be5995c568 for instance with vm_state active and task_state resize_migrating. Jan 26 19:06:20.629273 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3aa52a8e-b2b1-43e7-8490-ae84bf437c9c req-83bfbe81-e854-4e84-aef7-7984be30a9d3 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received event network-changed-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:06:20.629634 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3aa52a8e-b2b1-43e7-8490-ae84bf437c9c req-83bfbe81-e854-4e84-aef7-7984be30a9d3 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Refreshing instance network info cache due to event network-changed-5cc84259-b85d-4859-ae79-2274980583af. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:06:20.629933 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3aa52a8e-b2b1-43e7-8490-ae84bf437c9c req-83bfbe81-e854-4e84-aef7-7984be30a9d3 service nova] Acquiring lock "refresh_cache-15a722c1-acc4-4b55-be3b-4f339ef40d15" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:06:20.832394 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:06:20.832394 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.325s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:20.858703 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:06:20.861601 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:06:20.879341 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:20.879341 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:20.879341 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=189076) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}} Jan 26 19:06:21.054312 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:06:21.056091 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:06:21.056470 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Creating image(s) Jan 26 19:06:21.057117 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "/opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:21.057540 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "/opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:21.058284 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "/opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:21.059003 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:06:21.063262 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:06:21.064687 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:21.147092 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.082s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:21.148400 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:21.148956 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:21.150015 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:06:21.156899 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:06:21.156899 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:21.168909 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:06:21.247734 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.092s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:21.248388 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:21.264929 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c0c73f11-b207-402a-bb69-1920b0a4f22d tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "e6131b49-ccfa-43e4-9480-76d9062c4e48" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 5.486s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:21.266800 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "e6131b49-ccfa-43e4-9480-76d9062c4e48" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 5.384s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:21.267618 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "e6131b49-ccfa-43e4-9480-76d9062c4e48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:21.267788 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "e6131b49-ccfa-43e4-9480-76d9062c4e48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:21.268219 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "e6131b49-ccfa-43e4-9480-76d9062c4e48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:21.271167 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Terminating instance Jan 26 19:06:21.317106 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk 1073741824" returned: 0 in 0.069s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:21.317518 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.168s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:21.317866 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:21.357179 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:21.409990 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.092s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:21.410361 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:06:21.410736 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:21.487242 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk --force-share --output=json" returned: 0 in 0.073s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:21.487242 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Cannot resize image /opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:06:21.487242 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:06:21.487242 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Ensure instance console log exists: /opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:06:21.487242 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:21.487242 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:21.487242 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:21.487242 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Updating instance_info_cache with network_info: [{"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:06:21.775328 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:06:21.799959 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:21.806408 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:21.826402 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:21.831781 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:06:21.832386 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:06:21.832519 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:06:21.832713 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:06:21.832834 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:06:21.832963 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:06:21.837402 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:21.854208 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:21.854555 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:21.891450 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-95cb20c5-4925-4d98-96b3-558ab4c6dba0 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.014s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:21.895373 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:06:21.948645 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Port 0c5d371a-1c65-41be-864a-81be5995c568 binding to destination host np0005596550.novalocal is already ACTIVE {{(pid=189076) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jan 26 19:06:21.952139 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7717f984-4cef-4811-b0f0-75b917910eec req-d32c77da-e7ff-4f4b-b367-59c813fe8a53 service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Received event network-vif-unplugged-e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:06:21.952314 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7717f984-4cef-4811-b0f0-75b917910eec req-d32c77da-e7ff-4f4b-b367-59c813fe8a53 service nova] Acquiring lock "e6131b49-ccfa-43e4-9480-76d9062c4e48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:21.952473 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7717f984-4cef-4811-b0f0-75b917910eec req-d32c77da-e7ff-4f4b-b367-59c813fe8a53 service nova] Lock "e6131b49-ccfa-43e4-9480-76d9062c4e48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:21.952603 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7717f984-4cef-4811-b0f0-75b917910eec req-d32c77da-e7ff-4f4b-b367-59c813fe8a53 service nova] Lock "e6131b49-ccfa-43e4-9480-76d9062c4e48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:21.952733 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7717f984-4cef-4811-b0f0-75b917910eec req-d32c77da-e7ff-4f4b-b367-59c813fe8a53 service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] No waiting events found dispatching network-vif-unplugged-e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:06:21.952889 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7717f984-4cef-4811-b0f0-75b917910eec req-d32c77da-e7ff-4f4b-b367-59c813fe8a53 service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Received event network-vif-unplugged-e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:06:21.991488 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Releasing lock "refresh_cache-15a722c1-acc4-4b55-be3b-4f339ef40d15" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:06:21.991488 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Instance network_info: |[{"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:06:21.991488 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3aa52a8e-b2b1-43e7-8490-ae84bf437c9c req-83bfbe81-e854-4e84-aef7-7984be30a9d3 service nova] Acquired lock "refresh_cache-15a722c1-acc4-4b55-be3b-4f339ef40d15" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:06:21.991488 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-3aa52a8e-b2b1-43e7-8490-ae84bf437c9c req-83bfbe81-e854-4e84-aef7-7984be30a9d3 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Refreshing network info cache for port 5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:06:21.995374 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Start _get_guest_xml network_info=[{"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:06:22.008787 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:06:22.010141 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestJSON-server-1024970397', uuid='15a722c1-acc4-4b55-be3b-4f339ef40d15'), owner=OwnerMeta(userid='25c3c9ca754941ccbd986028c2a87e07', username='tempest-ServerActionsTestJSON-960489083-project-member', projectid='2efcb8570b994820a5956fab4e859054', projectname='tempest-ServerActionsTestJSON-960489083'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472382.0097451) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:06:22.012992 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:22.014468 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:06:22.015100 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:06:22.024382 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:06:22.024792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:06:22.025846 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:06:22.026171 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:06:22.026345 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:06:22.026515 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:06:22.026702 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:06:22.026936 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:06:22.027090 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:06:22.027280 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:06:22.027427 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:06:22.027608 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:06:22.027749 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:06:22.029236 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:06:22.031142 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:06:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1024970397',display_name='tempest-ServerActionsTestJSON-server-1024970397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestjson-server-1024970397',id=72,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaqJcAWtBvnDQt3Z0Zs2SEk8GmS4qswJn8I3pLNnZ26AiUp6izAb2VATu7Ta6RkUjooYd/ncwVnO6h5/K851Ht4DSyJ8eVOthZpoT3zQfgSsI2MjV6hMkI8XyrAdvV6PQ==',key_name='tempest-keypair-571396453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-ch4h3rbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:06:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=15a722c1-acc4-4b55-be3b-4f339ef40d15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:06:22.031374 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:06:22.032085 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=5cc84259-b85d-4859-ae79-2274980583af,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc84259-b8') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:06:22.032760 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'pci_devices' on Instance uuid 15a722c1-acc4-4b55-be3b-4f339ef40d15 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:06:22.058941 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Instance destroyed successfully. Jan 26 19:06:22.059347 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lazy-loading 'resources' on Instance uuid e6131b49-ccfa-43e4-9480-76d9062c4e48 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:06:22.146434 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Acquiring lock "2f9056ef-40b7-40df-8a63-d2328ad5987e" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:22.146600 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "2f9056ef-40b7-40df-8a63-d2328ad5987e" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:22.146761 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Acquiring lock "2f9056ef-40b7-40df-8a63-d2328ad5987e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:22.146933 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "2f9056ef-40b7-40df-8a63-d2328ad5987e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:22.147074 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "2f9056ef-40b7-40df-8a63-d2328ad5987e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:22.149109 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Terminating instance Jan 26 19:06:22.497809 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-3aa52a8e-b2b1-43e7-8490-ae84bf437c9c req-83bfbe81-e854-4e84-aef7-7984be30a9d3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] End _get_guest_xml xml= Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: 15a722c1-acc4-4b55-be3b-4f339ef40d15 Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: instance-00000048 Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestJSON-server-1024970397 Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:06:22 Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestJSON-960489083-project-member Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestJSON-960489083 Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: 15a722c1-acc4-4b55-be3b-4f339ef40d15 Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: 15a722c1-acc4-4b55-be3b-4f339ef40d15 Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:22.539175 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:06:22.541040 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Preparing to wait for external event network-vif-plugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:06:22.541040 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:22.541040 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:22.541040 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:22.542131 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:06:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1024970397',display_name='tempest-ServerActionsTestJSON-server-1024970397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestjson-server-1024970397',id=72,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaqJcAWtBvnDQt3Z0Zs2SEk8GmS4qswJn8I3pLNnZ26AiUp6izAb2VATu7Ta6RkUjooYd/ncwVnO6h5/K851Ht4DSyJ8eVOthZpoT3zQfgSsI2MjV6hMkI8XyrAdvV6PQ==',key_name='tempest-keypair-571396453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-ch4h3rbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:06:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=15a722c1-acc4-4b55-be3b-4f339ef40d15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:06:22.542387 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:06:22.543039 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=5cc84259-b85d-4859-ae79-2274980583af,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc84259-b8') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:06:22.543374 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=5cc84259-b85d-4859-ae79-2274980583af,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc84259-b8') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:06:22.543815 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:22.544149 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:06:22.544442 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:06:22.545997 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:22.546275 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4cfab2be-052b-59c2-9eb6-01344db7600b', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:06:22.561889 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-570532072',display_name='tempest-VolumesSnapshotTestJSON-instance-570532072',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-volumessnapshottestjson-instance-570532072',id=69,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEptXtRwQl+m7IMu+lc3XKgLkXexCd6eGnQ/2x/e3xllggtnNpbNn8xpwY5xeXdRzW7i0X3Ur4XAGdvln6LGUhfvxFRkGOi399SUYq9B3Fnvra7dptnaJGGNFSeM12Za+w==',key_name='tempest-keypair-16327304',keypairs=,launch_index=0,launched_at=2026-01-27T00:05:30Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='c55032abafa74d4facac03929da4a366',ramdisk_id='',reservation_id='r-o8zz3v6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-666453103',owner_user_name='tempest-VolumesSnapshotTestJSON-666453103-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:05:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9bb266354284323ae54b4c3317c26e5',uuid=e6131b49-ccfa-43e4-9480-76d9062c4e48,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48", "address": "fa:16:3e:9b:37:0d", "network": {"id": "e3c16b95-f7e4-4902-8796-2e826827292b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093833914-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c55032abafa74d4facac03929da4a366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b3b0ae-bb", "ovs_interfaceid": "e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:06:22.562254 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Converting VIF {"id": "e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48", "address": "fa:16:3e:9b:37:0d", "network": {"id": "e3c16b95-f7e4-4902-8796-2e826827292b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093833914-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c55032abafa74d4facac03929da4a366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b3b0ae-bb", "ovs_interfaceid": "e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:06:22.562797 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:37:0d,bridge_name='br-int',has_traffic_filtering=True,id=e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48,network=Network(e3c16b95-f7e4-4902-8796-2e826827292b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b3b0ae-bb') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:06:22.563110 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:37:0d,bridge_name='br-int',has_traffic_filtering=True,id=e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48,network=Network(e3c16b95-f7e4-4902-8796-2e826827292b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b3b0ae-bb') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:06:22.585349 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:22.586626 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:06:22.594349 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:22.595943 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:22.596220 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4b3b0ae-bb, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:06:22.601430 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:22.607184 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:06:22.607501 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:22.622645 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cc84259-b8, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:06:22.623051 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5cc84259-b8, col_values=(('qos', UUID('9e65a2e6-c8d7-485e-bf48-aa0c5b5a0405')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:06:22.623305 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5cc84259-b8, col_values=(('external_ids', {'iface-id': '5cc84259-b85d-4859-ae79-2274980583af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:56:7b', 'vm-uuid': '15a722c1-acc4-4b55-be3b-4f339ef40d15'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:06:22.624511 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:22.627868 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:06:22.633433 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:22.634368 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=5cc84259-b85d-4859-ae79-2274980583af,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc84259-b8') Jan 26 19:06:22.636899 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:22.637246 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0155fddc-9e41-4a4e-b7e6-7245c044bd08) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:06:22.638498 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:22.642860 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:06:22.645327 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:22.649298 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:37:0d,bridge_name='br-int',has_traffic_filtering=True,id=e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48,network=Network(e3c16b95-f7e4-4902-8796-2e826827292b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b3b0ae-bb') Jan 26 19:06:22.652028 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Acquiring lock "refresh_cache-2f9056ef-40b7-40df-8a63-d2328ad5987e" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:06:22.652301 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Acquired lock "refresh_cache-2f9056ef-40b7-40df-8a63-d2328ad5987e" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:06:22.652538 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:06:22.655556 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] calling os-brick to detach iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jan 26 19:06:22.656374 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-fc88f51d-d7b1-4097-802e-4391470eeab1', 'target_lun': 0, 'volume_id': 'fc88f51d-d7b1-4097-802e-4391470eeab1', 'auth_method': 'CHAP', 'auth_username': 'AqXp2jypWCEhwN2JacNe', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sda'}, None), 'kwargs': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:06:22.656930 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:06:22.657455 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:06:22.658623 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:22.668966 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:22.669123 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[eb360736-374c-4e6f-acb3-8a78333fb74b]: Unexpected error while running command. Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: Command: iscsiadm -m discoverydb -o show -P 1 Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: Exit code: 21 Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n' Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: Stderr: '' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 388, in execute Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: raise ProcessExecutionError(exit_code=_returncode, Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command. Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: Command: iscsiadm -m discoverydb -o show -P 1 Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: Exit code: 21 Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n' Jan 26 19:06:22.670247 np0005596550.novalocal nova-compute[189076]: Stderr: '' Jan 26 19:06:22.670954 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb360736-374c-4e6f-acb3-8a78333fb74b]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 388, in execute\n raise ProcessExecutionError(exit_code=_returncode,\noslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.\nCommand: iscsiadm -m discoverydb -o show -P 1\nExit code: 21\nStdout: \'SENDTARGETS:\\nNo targets found.\\niSNS:\\nNo targets found.\\nSTATIC:\\nNo targets found.\\nFIRMWARE:\\nNo targets found.\\n\'\nStderr: \'\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command. Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: Command: iscsiadm -m discoverydb -o show -P 1 Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: Exit code: 21 Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n' Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: Stderr: '' Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last): Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py", line 227, in _get_ips_iqns_luns Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ips_iqns_luns = method(connection_properties) Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py", line 386, in _get_discoverydb_portals Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi out = self._run_iscsiadm_bare(['-m', 'discoverydb', Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py", line 1218, in _run_iscsiadm_bare Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi (out, err) = self._execute('iscsiadm', Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/os_brick/executor.py", line 55, in _execute Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi result = self.__execute(*args, **kwargs) Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 173, in execute Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi return execute_root(*cmd, **kwargs) Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 267, in _wrap Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi return self.channel.remote_call(name, args, kwargs, Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 230, in remote_call Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi raise exc_type(*result[2]) Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command. Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1 Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21 Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n' Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Stderr: '' Jan 26 19:06:22.673068 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Jan 26 19:06:22.673751 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Skipping cleanup Unable to find target portal 38.102.83.18:3260. {{(pid=189076) _cleanup_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:959}} Jan 26 19:06:22.674080 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.017s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:06:22.674291 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] <== disconnect_volume: return (17ms) None {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:06:22.674531 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Disconnected iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jan 26 19:06:22.674861 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Deleting instance files /opt/stack/data/nova/instances/e6131b49-ccfa-43e4-9480-76d9062c4e48_del Jan 26 19:06:22.675440 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Deletion of /opt/stack/data/nova/instances/e6131b49-ccfa-43e4-9480-76d9062c4e48_del complete Jan 26 19:06:22.817803 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-3aa52a8e-b2b1-43e7-8490-ae84bf437c9c req-83bfbe81-e854-4e84-aef7-7984be30a9d3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:22.938803 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-3aa52a8e-b2b1-43e7-8490-ae84bf437c9c req-83bfbe81-e854-4e84-aef7-7984be30a9d3 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Updated VIF entry in instance network info cache for port 5cc84259-b85d-4859-ae79-2274980583af. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:06:22.938803 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-3aa52a8e-b2b1-43e7-8490-ae84bf437c9c req-83bfbe81-e854-4e84-aef7-7984be30a9d3 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Updating instance_info_cache with network_info: [{"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:06:22.979046 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:22.979046 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:22.979046 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:23.155212 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:23.189518 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Took 1.41 seconds to destroy the instance on the hypervisor. Jan 26 19:06:23.190600 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:06:23.191013 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:06:23.191268 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:06:23.191658 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:23.210264 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:06:23.274470 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:23.313052 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:06:23.441984 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3aa52a8e-b2b1-43e7-8490-ae84bf437c9c req-83bfbe81-e854-4e84-aef7-7984be30a9d3 service nova] Releasing lock "refresh_cache-15a722c1-acc4-4b55-be3b-4f339ef40d15" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:06:23.652311 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-8298aab5-c1cd-48fa-89a4-a06a0eecf079 req-8dbc69eb-beff-4a6c-a6ca-d1f5ef7da501 service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Received event network-vif-deleted-e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:06:23.652311 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-8298aab5-c1cd-48fa-89a4-a06a0eecf079 req-8dbc69eb-beff-4a6c-a6ca-d1f5ef7da501 service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Neutron deleted interface e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48; detaching it from the instance and deleting it from the info cache Jan 26 19:06:23.652311 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-8298aab5-c1cd-48fa-89a4-a06a0eecf079 req-8dbc69eb-beff-4a6c-a6ca-d1f5ef7da501 service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:06:23.814540 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Releasing lock "refresh_cache-2f9056ef-40b7-40df-8a63-d2328ad5987e" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:06:23.814540 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:06:23.982790 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:23.996966 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-0b3ecf8a-5495-431b-9b9f-82b137b99ac6 req-9a37c032-245b-4573-95aa-9952ccc4032f service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Received event network-vif-unplugged-e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:06:23.997288 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-0b3ecf8a-5495-431b-9b9f-82b137b99ac6 req-9a37c032-245b-4573-95aa-9952ccc4032f service nova] Acquiring lock "e6131b49-ccfa-43e4-9480-76d9062c4e48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:23.997512 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-0b3ecf8a-5495-431b-9b9f-82b137b99ac6 req-9a37c032-245b-4573-95aa-9952ccc4032f service nova] Lock "e6131b49-ccfa-43e4-9480-76d9062c4e48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:23.997739 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-0b3ecf8a-5495-431b-9b9f-82b137b99ac6 req-9a37c032-245b-4573-95aa-9952ccc4032f service nova] Lock "e6131b49-ccfa-43e4-9480-76d9062c4e48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:23.997972 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-0b3ecf8a-5495-431b-9b9f-82b137b99ac6 req-9a37c032-245b-4573-95aa-9952ccc4032f service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] No waiting events found dispatching network-vif-unplugged-e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:06:23.998299 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-0b3ecf8a-5495-431b-9b9f-82b137b99ac6 req-9a37c032-245b-4573-95aa-9952ccc4032f service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Received event network-vif-unplugged-e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:06:24.030381 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "refresh_cache-c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:06:24.030720 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquired lock "refresh_cache-c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:06:24.030963 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:06:24.052237 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Instance destroyed successfully. Jan 26 19:06:24.052237 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lazy-loading 'resources' on Instance uuid 2f9056ef-40b7-40df-8a63-d2328ad5987e {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:06:24.127221 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:06:24.156033 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-8298aab5-c1cd-48fa-89a4-a06a0eecf079 req-8dbc69eb-beff-4a6c-a6ca-d1f5ef7da501 service nova] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Detach interface failed, port_id=e4b3b0ae-bbb2-420d-8020-8ddeb1cf1c48, reason: Instance e6131b49-ccfa-43e4-9480-76d9062c4e48 could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:06:24.158114 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:06:24.158309 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:06:24.158497 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] No VIF found with MAC fa:16:3e:34:56:7b, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:06:24.159103 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Using config drive Jan 26 19:06:24.311576 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:06:24.311576 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] VM Stopped (Lifecycle Event) Jan 26 19:06:24.534392 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:24.554069 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Deleting instance files /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e_del Jan 26 19:06:24.554439 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Deletion of /opt/stack/data/nova/instances/2f9056ef-40b7-40df-8a63-d2328ad5987e_del complete Jan 26 19:06:24.630357 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Took 1.44 seconds to deallocate network for instance. Jan 26 19:06:24.645535 np0005596550.novalocal nova-compute[189076]: WARNING nova.volume.cinder [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Attachment 88d060a3-97a8-429a-9f2d-14fb5fd7b074 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 88d060a3-97a8-429a-9f2d-14fb5fd7b074. (HTTP 404) (Request-ID: req-02f83200-aa4a-49e7-b4c6-4f1b9ca2d81d) Jan 26 19:06:24.645736 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Took 0.02 seconds to detach 1 volumes for instance. Jan 26 19:06:24.665037 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:24.798040 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Creating config drive at /opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk.config Jan 26 19:06:24.801253 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmptc4l1k9p {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:24.814524 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-75ace470-6ef5-415e-baab-03401d46830b None None] [instance: 48ff5e37-56fe-46a8-b14c-8e4cf3197fb5] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:06:24.822828 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:24.919072 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Updating instance_info_cache with network_info: [{"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:06:24.926987 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmptc4l1k9p" returned: 0 in 0.126s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:25.030228 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:25.036522 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:25.070438 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Took 1.25 seconds to destroy the instance on the hypervisor. Jan 26 19:06:25.070438 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:06:25.070438 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:06:25.070438 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:06:25.070438 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:25.122032 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:06:25.122309 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:25.156833 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:25.156833 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:25.214065 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:06:25.214233 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] VM Started (Lifecycle Event) Jan 26 19:06:25.238362 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:06:25.243183 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:06:25.243240 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] VM Paused (Lifecycle Event) Jan 26 19:06:25.364413 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:25.401961 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:06:25.421918 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Releasing lock "refresh_cache-c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:06:25.629449 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:06:25.746463 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:06:25.750313 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:06:25.905849 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:06:25.933105 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': True, 'host': 'np0005596550.novalocal', 'execute': None}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:06:25.934436 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:25.942154 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:25.942397 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abf0d62-b3fe-4841-9f9b-6a914437a3da]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:25.945705 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[21a1b767-8ff1-48b8-90ce-72e4e1736ab4]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:06:25.945705 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:06:25.945705 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:06:25.945705 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:06:25.945705 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:25.945705 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:06:25.945705 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:06:25.945705 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:25.945705 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:06:25.945705 np0005596550.novalocal nova-compute[189076]: with open_scini_device() as fd: Jan 26 19:06:25.945705 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:25.945705 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:06:25.945705 np0005596550.novalocal nova-compute[189076]: return next(self.gen) Jan 26 19:06:25.945705 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^ Jan 26 19:06:25.945705 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:06:25.945705 np0005596550.novalocal nova-compute[189076]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:06:25.945705 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:25.945705 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:06:25.946571 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a1b767-8ff1-48b8-90ce-72e4e1736ab4]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:25.947181 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.scaleio [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:06:25.947538 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.scaleio [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:06:25.948353 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:25.959163 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:25.959309 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4652e65a-6cf1-421f-86e5-d025fd171e03]: (4, ('/dev/vda2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:25.960180 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:25.978523 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.018s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:25.978718 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[998fc229-0a60-4e7a-abb6-05d8fd70213d]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:25.979886 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11cfb84-83b2-48b2-a5a4-d45071a1e253]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:25.980294 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): nvme version {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:25.998498 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] 'nvme version' failed. Not Retrying. {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:06:25.998997 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] nvme not present on system {{(pid=189076) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:06:26.002471 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=189076) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:06:26.002988 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.lightos [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::64f3:a5ff:fe22:3e52', 'fe80::fc16:3eff:fe5d:9ebd', 'fe80::fc16:3eff:fe34:567b', 'fe80::9440:7dff:fe4f:8f89'] Jan 26 19:06:26.003192 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:06:26.003549 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:06:26.004796 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] <== get_connector_properties: return (69ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': True, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::64f3:a5ff:fe22:3e52', 'fe80::fc16:3eff:fe5d:9ebd', 'fe80::fc16:3eff:fe34:567b', 'fe80::9440:7dff:fe4f:8f89']} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:06:26.020666 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-09803124-dbbb-4cc1-a1a5-6f932acd1680 req-1f787e0e-d75e-4a20-bb2b-7e4420b95962 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received event network-vif-plugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:06:26.021013 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-09803124-dbbb-4cc1-a1a5-6f932acd1680 req-1f787e0e-d75e-4a20-bb2b-7e4420b95962 service nova] Acquiring lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:26.021275 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-09803124-dbbb-4cc1-a1a5-6f932acd1680 req-1f787e0e-d75e-4a20-bb2b-7e4420b95962 service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:26.021489 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-09803124-dbbb-4cc1-a1a5-6f932acd1680 req-1f787e0e-d75e-4a20-bb2b-7e4420b95962 service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:26.021705 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-09803124-dbbb-4cc1-a1a5-6f932acd1680 req-1f787e0e-d75e-4a20-bb2b-7e4420b95962 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Processing event network-vif-plugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:06:26.021959 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-09803124-dbbb-4cc1-a1a5-6f932acd1680 req-1f787e0e-d75e-4a20-bb2b-7e4420b95962 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received event network-vif-plugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:06:26.022171 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-09803124-dbbb-4cc1-a1a5-6f932acd1680 req-1f787e0e-d75e-4a20-bb2b-7e4420b95962 service nova] Acquiring lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:26.022394 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-09803124-dbbb-4cc1-a1a5-6f932acd1680 req-1f787e0e-d75e-4a20-bb2b-7e4420b95962 service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:26.022575 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-09803124-dbbb-4cc1-a1a5-6f932acd1680 req-1f787e0e-d75e-4a20-bb2b-7e4420b95962 service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:26.022777 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-09803124-dbbb-4cc1-a1a5-6f932acd1680 req-1f787e0e-d75e-4a20-bb2b-7e4420b95962 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] No waiting events found dispatching network-vif-plugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:06:26.023016 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-09803124-dbbb-4cc1-a1a5-6f932acd1680 req-1f787e0e-d75e-4a20-bb2b-7e4420b95962 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received unexpected event network-vif-plugged-5cc84259-b85d-4859-ae79-2274980583af for instance with vm_state building and task_state spawning. Jan 26 19:06:26.023945 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:06:26.031040 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:06:26.035707 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Instance spawned successfully. Jan 26 19:06:26.036136 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:06:26.132436 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Took 1.06 seconds to deallocate network for instance. Jan 26 19:06:26.254047 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:06:26.254444 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:06:26.254444 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] VM Resumed (Lifecycle Event) Jan 26 19:06:26.413403 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.257s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:26.453296 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Deleted allocations for instance e6131b49-ccfa-43e4-9480-76d9062c4e48 Jan 26 19:06:26.544957 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:06:26.545149 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:06:26.545508 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:06:26.545847 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:06:26.546201 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:06:26.546556 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:06:26.645063 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:26.645442 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:26.769058 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:06:26.773527 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:06:26.844957 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:06:27.018298 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:27.052217 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Took 6.00 seconds to spawn the instance on the hypervisor. Jan 26 19:06:27.052443 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:06:27.275841 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:06:27.349498 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:06:27.467524 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-74cfbe5c-4a3d-4eb8-bf32-51dbcdc51c7a tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "e6131b49-ccfa-43e4-9480-76d9062c4e48" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.198s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:27.563617 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Took 11.37 seconds to build instance. Jan 26 19:06:27.693802 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:27.856875 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.211s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:27.929320 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Deleted allocations for instance 2f9056ef-40b7-40df-8a63-d2328ad5987e Jan 26 19:06:28.065860 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e56c5532-7cf7-442d-a7f7-d79aeeb739a2 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 12.878s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:28.318207 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f288b9c4-001a-47a7-8e27-2a99ea58585b req-63bec444-0363-4550-bc29-318bfa2a9c00 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received event network-changed-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:06:28.318583 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f288b9c4-001a-47a7-8e27-2a99ea58585b req-63bec444-0363-4550-bc29-318bfa2a9c00 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Refreshing instance network info cache due to event network-changed-5cc84259-b85d-4859-ae79-2274980583af. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:06:28.318997 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f288b9c4-001a-47a7-8e27-2a99ea58585b req-63bec444-0363-4550-bc29-318bfa2a9c00 service nova] Acquiring lock "refresh_cache-15a722c1-acc4-4b55-be3b-4f339ef40d15" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:06:28.319253 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f288b9c4-001a-47a7-8e27-2a99ea58585b req-63bec444-0363-4550-bc29-318bfa2a9c00 service nova] Acquired lock "refresh_cache-15a722c1-acc4-4b55-be3b-4f339ef40d15" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:06:28.320871 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-f288b9c4-001a-47a7-8e27-2a99ea58585b req-63bec444-0363-4550-bc29-318bfa2a9c00 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Refreshing network info cache for port 5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:06:28.824873 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-f288b9c4-001a-47a7-8e27-2a99ea58585b req-63bec444-0363-4550-bc29-318bfa2a9c00 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:28.938510 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a3557b8a-96e3-448c-b1f4-f6838b1f0c13 tempest-ServerShowV254Test-851494845 tempest-ServerShowV254Test-851494845-project-member] Lock "2f9056ef-40b7-40df-8a63-d2328ad5987e" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.792s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:29.038236 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-f288b9c4-001a-47a7-8e27-2a99ea58585b req-63bec444-0363-4550-bc29-318bfa2a9c00 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:29.137537 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-f288b9c4-001a-47a7-8e27-2a99ea58585b req-63bec444-0363-4550-bc29-318bfa2a9c00 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Updated VIF entry in instance network info cache for port 5cc84259-b85d-4859-ae79-2274980583af. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:06:29.137812 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-f288b9c4-001a-47a7-8e27-2a99ea58585b req-63bec444-0363-4550-bc29-318bfa2a9c00 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Updating instance_info_cache with network_info: [{"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:06:29.640807 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f288b9c4-001a-47a7-8e27-2a99ea58585b req-63bec444-0363-4550-bc29-318bfa2a9c00 service nova] Releasing lock "refresh_cache-15a722c1-acc4-4b55-be3b-4f339ef40d15" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:06:31.240270 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Starting finish_migration {{(pid=189076) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12668}} Jan 26 19:06:31.241306 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Instance directory exists: not creating {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5157}} Jan 26 19:06:31.241449 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Creating image(s) Jan 26 19:06:31.242517 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:31.341101 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.098s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:31.341720 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:06:31.342202 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:31.420096 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:31.420711 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Cannot resize image /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:06:31.929167 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Did not create local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5295}} Jan 26 19:06:31.929520 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Ensure instance console log exists: /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:06:31.930117 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:31.930487 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:31.930803 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:31.939601 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Start _get_guest_xml network_info=[{"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-630226605-network", "vif_mac": "fa:16:3e:5b:de:3a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': 'd75230b9-a1c8-49ed-ab08-504dcd7dbd94', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'target_lun': 0, 'volume_id': '8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'auth_method': 'CHAP', 'auth_username': 'DJGdCSYcXoX7W45zGsrh', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6', 'attached_at': '2026-01-27T00:06:30.000000', 'detached_at': '', 'volume_id': '8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'serial': '8ca88aff-367a-4ce7-9a74-4ca46af97c3f'}, 'boot_index': None, 'device_type': 'disk', 'volume_type': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:06:31.944439 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:06:31.946401 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1924433663', uuid='c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6'), owner=OwnerMeta(userid='8369268788c24337ade1739d948c300a', username='tempest-ServerActionsTestOtherB-1262198412-project-member', projectid='8428b9d1e48c42f690612bf1e012ec42', projectname='tempest-ServerActionsTestOtherB-1262198412'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-630226605-network", "vif_mac": "fa:16:3e:5b:de:3a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472391.9458172) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:06:31.947989 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:06:31.948632 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:06:31.951446 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:06:31.951749 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:06:31.952579 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:06:31.952923 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:06:31.953163 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:06:31.953217 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:06:31.953358 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:06:31.953496 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:06:31.953594 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:06:31.953802 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:06:31.953919 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:06:31.954067 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:06:31.954183 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:06:31.954321 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:06:31.956988 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk.config --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:32.020978 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:32.065725 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk.config --force-share --output=json" returned: 0 in 0.108s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:32.066170 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "/opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:32.066457 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "/opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:32.067232 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "/opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:32.067633 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Calling os-brick to attach iSCSI Volume {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jan 26 19:06:32.068629 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'target_lun': 0, 'volume_id': '8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'auth_method': 'CHAP', 'auth_username': 'DJGdCSYcXoX7W45zGsrh', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:06:32.068629 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:06:32.069253 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:06:32.069455 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'target_lun': 0, 'volume_id': '8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'auth_method': 'CHAP', 'auth_username': 'DJGdCSYcXoX7W45zGsrh', 'auth_password': 'QYEGK4BnLv8mKnEB', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True} {{(pid=189076) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:06:32.070355 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:32.076369 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:06:32.077699 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[a99aca34-27ce-4acb-bab4-da5ffc6c023f]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:06:32.077699 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:06:32.077699 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:06:32.077699 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:06:32.077699 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:32.077699 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:06:32.077699 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:06:32.077699 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:32.077699 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:06:32.077699 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:06:32.077699 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:32.077699 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:06:32.077699 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:06:32.077699 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:32.077699 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:06:32.077699 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:06:32.077699 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:32.077699 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:06:32.077699 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:06:32.077699 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:06:32.077699 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:06:32.077699 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:06:32.078514 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99aca34-27ce-4acb-bab4-da5ffc6c023f]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:32.079285 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:06:32.079709 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:06:32.080111 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:06:32.080798 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:32.091523 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260" returned: 21 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:32.093204 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d15f88-f935-4aad-9f7e-2145c9af25b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:32.093975 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:06:32.093975 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:32.094972 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --interface default --op new {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:32.105389 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:32.105620 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2037f8-6117-48c7-afff-77e3ba3a2050]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:32.106225 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f] added Jan 26 19:06:32.106225 np0005596550.novalocal nova-compute[189076]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:06:32.106225 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:06:32.106225 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:06:32.106225 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:32.106435 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=189076) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:06:32.106840 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.027(s), this was the 1st time calling it. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:06:32.107235 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:06:32.770623 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:33.108083 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:06:33.109182 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:33.119112 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:33.119814 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[847d8459-9139-40e3-91f9-c1d2505fea62]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.name = iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.tpgt = -1 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.startup = automatic Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.leading_login = No Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.iscsi_ifacename = default Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.net_ifacename = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.ipaddress = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.prefix_len = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.hwaddress = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.transport_name = tcp Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.initiatorname = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.state = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.vlan_id = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.vlan_priority = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.vlan_state = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.iface_num = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.mtu = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.port = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.bootproto = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.subnet_mask = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.gateway = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id_state = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.dhcp_dns = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.dhcp_learn_iqn = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.dhcp_req_vendor_id_state = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id_state = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.dhcp_slp_da = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.fragmentation = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.gratuitous_arp = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.incoming_forwarding = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.tos_state = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.tos = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.ttl = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.delayed_ack = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.tcp_nagle = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf_state = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.tcp_timer_scale = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.tcp_timestamp = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.redirect = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.def_task_mgmt_timeout = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.header_digest = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.data_digest = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.immediate_data = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.initial_r2t = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.data_seq_inorder = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.data_pdu_inorder = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.erl = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.max_receive_data_len = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.first_burst_len = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.max_outstanding_r2t = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.max_burst_len = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.chap_auth = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.bidi_chap = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.strict_login_compliance = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.discovery_auth = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: iface.discovery_logout = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.discovery_address = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.discovery_port = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.discovery_type = fw Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.initial_cmdsn = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.initial_login_retry_max = 8 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.xmit_thread_priority = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.cmds_max = 128 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.queue_depth = 32 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.nr_sessions = 1 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.auth.authmethod = None Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.auth.username = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.auth.password = *** Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.auth.username_in = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.auth.password_in = Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.timeo.replacement_timeout = 120 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FastAbort = Yes Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.InitialR2T = No Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ImmediateData = Yes Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxConnections = 1 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ERL = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.scan = auto Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.reopen_max = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.session.conn_reopen_log_freq = 1 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.conn[0].address = 38.102.83.18 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.conn[0].port = 3260 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.conn[0].startup = manual Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.window_size = 524288 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.DataDigest = None Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.IFMarker = No Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.OFMarker = No Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: # END RECORD Jan 26 19:06:33.122518 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:33.126344 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:33.133234 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:33.133418 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dac825f-2f8b-48f2-8bc4-c0524f0cd092]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:33.133893 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:33.134636 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:33.152077 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:33.152269 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b6c733-aebb-43aa-86c0-8b18616749cb]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:33.152802 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:33.154897 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.auth.username -v DJGdCSYcXoX7W45zGsrh {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:33.170385 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.auth.username -v DJGdCSYcXoX7W45zGsrh" returned: 0 in 0.016s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:33.170548 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a2ccae-54e6-4f64-890a-6529a4b94562]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:33.170972 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DJGdCSYcXoX7W45zGsrh'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:33.173434 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:33.185919 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:33.186094 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4b0108-1eb6-4ec3-94e5-ac7316b332d0]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:33.186507 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:33.187354 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:33.199698 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:33.199878 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[2663efa3-feee-4152-a860-4218883fc15d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:33.201206 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jan 26 19:06:33.201206 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:06:33.201359 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jan 26 19:06:33.201359 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:06:33.201573 np0005596550.novalocal nova-compute[189076]: WARNING os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jan 26 19:06:33.201573 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:33.202594 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --login {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:33.217364 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --login" returned: 0 in 0.014s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:33.217498 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[da40b8ed-e231-4b44-bf16-8592da929ae3]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:33.217839 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f, portal: 38.102.83.18,3260] successful. Jan 26 19:06:33.217839 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:33.218515 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:33.230639 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:33.231202 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e186ce3-f680-4951-8e5b-64d7441a56f0]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:33.231561 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:33.232459 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:33.240465 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:33.240620 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6acf91c-961f-49fa-95e3-190f4e32e29c]: (4, ('tcp: [10] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:33.240984 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f (non-flash) Jan 26 19:06:33.240984 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:06:33.241153 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsi session list stdout=tcp: [10] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f (non-flash) Jan 26 19:06:33.241153 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:06:33.241462 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.162s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:06:33.241635 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Connected to 38.102.83.18:3260 {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:06:33.242047 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] HCTL ('2', '-', '-', 0) found on session 10 with lun 0 {{(pid=189076) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:06:33.242206 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Scanning host 2 c: -, t: -, l: 0) {{(pid=189076) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:06:33.243431 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host2/scan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:33.261706 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host2/scan" returned: 0 in 0.018s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:33.261867 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df112e8-7978-4212-9cce-71029c9dee56]: (4, ('- - 0', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:33.262481 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching for a device in session 10 and hctl ['2', '*', '*', 0] yield: None {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:06:33.742223 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:06:33.742389 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] VM Stopped (Lifecycle Event) Jan 26 19:06:34.247696 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-49ac53e9-6d85-4f44-9838-75c602c2328c None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:06:34.255909 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-49ac53e9-6d85-4f44-9838-75c602c2328c None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:06:34.266684 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching for a device in session 10 and hctl ['2', '*', '*', 0] yield: sda {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:06:34.267601 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Connected to sda using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'target_lun': 0, 'volume_id': '8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'auth_method': 'CHAP', 'auth_username': 'DJGdCSYcXoX7W45zGsrh', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True} {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:06:34.268591 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.199s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:06:34.270536 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] <== connect_volume: return (2200ms) {'type': 'block', 'scsi_wwn': '360014051a650fe7ac354c5cb11a9454f', 'path': '/dev/sda'} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:06:34.270928 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '360014051a650fe7ac354c5cb11a9454f', 'path': '/dev/sda'} {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jan 26 19:06:34.760548 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-49ac53e9-6d85-4f44-9838-75c602c2328c None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] During sync_power_state the instance has a pending task (resize_finish). Skip. Jan 26 19:06:34.783200 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:05:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1924433663',display_name='tempest-ServerActionsTestOtherB-server-1924433663',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-1924433663',id=68,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK72/fZgFXc8Nm23qFp5bqxu5uQWjdqvi6tf0S8eHH5LAOejrjAG2pg3k7mvst6GtMR5cAEv++XPpoBWMRpc6kXyw3lb+Uukjxykolyr/SPF2WcEU8zRsEYayUYxi/WyQ==',key_name='tempest-keypair-56259378',keypairs=,launch_index=0,launched_at=2026-01-27T00:05:28Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-i9xjjhbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:06:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-630226605-network", "vif_mac": "fa:16:3e:5b:de:3a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:06:34.783464 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-630226605-network", "vif_mac": "fa:16:3e:5b:de:3a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:06:34.784140 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:de:3a,bridge_name='br-int',has_traffic_filtering=True,id=0c5d371a-1c65-41be-864a-81be5995c568,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5d371a-1c') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] End _get_guest_xml xml= Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6 Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: instance-00000044 Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: 262144 Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-server-1924433663 Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:06:31 Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: 256 Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: ide Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: pc Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-1262198412-project-member Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-1262198412 Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6 Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6 Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: 8ca88aff-367a-4ce7-9a74-4ca46af97c3f Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: Jan 26 19:06:34.787121 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:06:34.788414 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:05:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1924433663',display_name='tempest-ServerActionsTestOtherB-server-1924433663',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-1924433663',id=68,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK72/fZgFXc8Nm23qFp5bqxu5uQWjdqvi6tf0S8eHH5LAOejrjAG2pg3k7mvst6GtMR5cAEv++XPpoBWMRpc6kXyw3lb+Uukjxykolyr/SPF2WcEU8zRsEYayUYxi/WyQ==',key_name='tempest-keypair-56259378',keypairs=,launch_index=0,launched_at=2026-01-27T00:05:28Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-i9xjjhbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:06:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-630226605-network", "vif_mac": "fa:16:3e:5b:de:3a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:06:34.788414 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-630226605-network", "vif_mac": "fa:16:3e:5b:de:3a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:06:34.788664 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:de:3a,bridge_name='br-int',has_traffic_filtering=True,id=0c5d371a-1c65-41be-864a-81be5995c568,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5d371a-1c') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:06:34.788971 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:de:3a,bridge_name='br-int',has_traffic_filtering=True,id=0c5d371a-1c65-41be-864a-81be5995c568,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5d371a-1c') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:06:34.789798 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:34.790634 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:06:34.790949 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:06:34.791600 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:34.791789 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea2c2523-d2d3-5ad2-ad14-3c5335468bcc', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:06:34.794229 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:34.796008 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:06:34.796219 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:34.800116 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:34.800315 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c5d371a-1c, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:06:34.800677 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c5d371a-1c, col_values=(('qos', UUID('1706b608-8cd8-455a-aab9-f887adecb697')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:06:34.800890 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c5d371a-1c, col_values=(('external_ids', {'iface-id': '0c5d371a-1c65-41be-864a-81be5995c568', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:de:3a', 'vm-uuid': 'c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:06:34.801913 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:34.808644 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:06:34.812113 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:34.813729 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:de:3a,bridge_name='br-int',has_traffic_filtering=True,id=0c5d371a-1c65-41be-864a-81be5995c568,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5d371a-1c') Jan 26 19:06:36.510913 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:06:36.511349 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No BDM found with device name vdb, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:06:36.511349 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:06:36.511438 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No VIF found with MAC fa:16:3e:5b:de:3a, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:06:36.512086 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Using config drive Jan 26 19:06:36.624863 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:36.630298 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:36.638222 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:36.773477 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:36.774629 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:37.021299 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:37.055874 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:06:37.056008 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] VM Stopped (Lifecycle Event) Jan 26 19:06:37.119688 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:06:37.120097 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] VM Resumed (Lifecycle Event) Jan 26 19:06:37.121802 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Instance event wait completed in 0 seconds for {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:06:37.126214 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Instance running successfully. Jan 26 19:06:37.127808 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Failed to set time: agent not configured {{(pid=189076) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}} Jan 26 19:06:37.127942 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-43c5c7a8-c3f8-4a1a-a2bb-db9db328589a tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] finish_migration finished successfully. {{(pid=189076) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12763}} Jan 26 19:06:37.559069 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-8d150c27-7d42-441f-96dc-d2fbc1588629 None None] [instance: e6131b49-ccfa-43e4-9480-76d9062c4e48] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:06:37.623553 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:06:37.626721 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:06:37.655347 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c5001995-ea84-45db-ab77-d9401007db47 req-9bd9b72b-7c95-4e5a-bed4-61617489b543 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received event network-vif-plugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:06:37.655499 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c5001995-ea84-45db-ab77-d9401007db47 req-9bd9b72b-7c95-4e5a-bed4-61617489b543 service nova] Acquiring lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:37.655661 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c5001995-ea84-45db-ab77-d9401007db47 req-9bd9b72b-7c95-4e5a-bed4-61617489b543 service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:37.655811 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c5001995-ea84-45db-ab77-d9401007db47 req-9bd9b72b-7c95-4e5a-bed4-61617489b543 service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:37.655942 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c5001995-ea84-45db-ab77-d9401007db47 req-9bd9b72b-7c95-4e5a-bed4-61617489b543 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] No waiting events found dispatching network-vif-plugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:06:37.656080 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-c5001995-ea84-45db-ab77-d9401007db47 req-9bd9b72b-7c95-4e5a-bed4-61617489b543 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received unexpected event network-vif-plugged-0c5d371a-1c65-41be-864a-81be5995c568 for instance with vm_state active and task_state resize_finish. Jan 26 19:06:38.130370 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] During sync_power_state the instance has a pending task (resize_finish). Skip. Jan 26 19:06:38.130613 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:06:38.130834 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] VM Started (Lifecycle Event) Jan 26 19:06:38.641062 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:06:38.645585 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:06:39.049195 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:06:39.049302 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] VM Stopped (Lifecycle Event) Jan 26 19:06:39.552592 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-9783f86a-1fd8-4a11-a1fa-411c8490bc9e None None] [instance: 2f9056ef-40b7-40df-8a63-d2328ad5987e] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:06:39.697525 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-84be4c53-1ec9-4a15-9157-19dce5521636 req-bad8d583-e1c5-457f-9049-aff2faa87721 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received event network-vif-plugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:06:39.697848 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-84be4c53-1ec9-4a15-9157-19dce5521636 req-bad8d583-e1c5-457f-9049-aff2faa87721 service nova] Acquiring lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:39.698072 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-84be4c53-1ec9-4a15-9157-19dce5521636 req-bad8d583-e1c5-457f-9049-aff2faa87721 service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:39.698259 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-84be4c53-1ec9-4a15-9157-19dce5521636 req-bad8d583-e1c5-457f-9049-aff2faa87721 service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:39.698466 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-84be4c53-1ec9-4a15-9157-19dce5521636 req-bad8d583-e1c5-457f-9049-aff2faa87721 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] No waiting events found dispatching network-vif-plugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:06:39.698700 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-84be4c53-1ec9-4a15-9157-19dce5521636 req-bad8d583-e1c5-457f-9049-aff2faa87721 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received unexpected event network-vif-plugged-0c5d371a-1c65-41be-864a-81be5995c568 for instance with vm_state resized and task_state None. Jan 26 19:06:39.804469 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:42.065740 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:42.403796 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:42.601285 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:42.601869 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:42.602345 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:43.662017 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Port 0c5d371a-1c65-41be-864a-81be5995c568 binding to destination host np0005596550.novalocal is already ACTIVE {{(pid=189076) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jan 26 19:06:43.662531 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "refresh_cache-c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:06:43.662697 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquired lock "refresh_cache-c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:06:43.663032 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:06:44.167507 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:44.821516 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:44.985293 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:45.148192 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Updating instance_info_cache with network_info: [{"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:06:45.652054 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Releasing lock "refresh_cache-c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:06:46.155623 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Creating tmpfile /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/tmp_wqsti65 to verify with other compute node that the instance is on the same shared storage. {{(pid=189076) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10477}} Jan 26 19:06:46.752840 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:46.760224 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:46.760593 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:46.854313 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:46.861021 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:46.951757 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Instance destroyed successfully. Jan 26 19:06:46.952182 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'resources' on Instance uuid c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:06:47.067386 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:47.459811 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:05:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1924433663',display_name='tempest-ServerActionsTestOtherB-server-1924433663',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-1924433663',id=68,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK72/fZgFXc8Nm23qFp5bqxu5uQWjdqvi6tf0S8eHH5LAOejrjAG2pg3k7mvst6GtMR5cAEv++XPpoBWMRpc6kXyw3lb+Uukjxykolyr/SPF2WcEU8zRsEYayUYxi/WyQ==',key_name='tempest-keypair-56259378',keypairs=,launch_index=0,launched_at=2026-01-27T00:06:38Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-i9xjjhbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:06:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6,vcpu_model=,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:06:47.459811 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:06:47.460624 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:de:3a,bridge_name='br-int',has_traffic_filtering=True,id=0c5d371a-1c65-41be-864a-81be5995c568,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5d371a-1c') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:06:47.460981 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:de:3a,bridge_name='br-int',has_traffic_filtering=True,id=0c5d371a-1c65-41be-864a-81be5995c568,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5d371a-1c') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:06:47.464808 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:47.464808 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c5d371a-1c, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:06:47.466693 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:47.471344 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:06:47.472601 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:47.473165 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1706b608-8cd8-455a-aab9-f887adecb697) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:06:47.476743 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:47.480059 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:de:3a,bridge_name='br-int',has_traffic_filtering=True,id=0c5d371a-1c65-41be-864a-81be5995c568,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5d371a-1c') Jan 26 19:06:47.482882 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] calling os-brick to detach iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jan 26 19:06:47.484494 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'target_lun': 0, 'volume_id': '8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'auth_method': 'CHAP', 'auth_username': 'DJGdCSYcXoX7W45zGsrh', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sda'}, None), 'kwargs': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:06:47.485158 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:06:47.486025 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:06:47.490299 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:47.498161 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:47.498817 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[2484168a-134a-4694-aad1-99fedda486db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:47.499165 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:06:47.499165 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:06:47.499165 np0005596550.novalocal nova-compute[189076]: iSNS: Jan 26 19:06:47.499165 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:06:47.499165 np0005596550.novalocal nova-compute[189076]: STATIC: Jan 26 19:06:47.499165 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f Jan 26 19:06:47.499165 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:06:47.499165 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:06:47.499165 np0005596550.novalocal nova-compute[189076]: FIRMWARE: Jan 26 19:06:47.499165 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:06:47.499165 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:06:47.499510 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:06:47.499510 np0005596550.novalocal nova-compute[189076]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:06:47.499510 np0005596550.novalocal nova-compute[189076]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=189076) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:06:47.499809 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 0)] {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:06:47.500351 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:47.507894 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:47.508211 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df7ae86-7703-42ee-91f6-5c5268eb6b2d]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:47.510395 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:47.517276 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:47.517585 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[06292e08-a833-4ba2-b29a-889eaf2f9e57]: (4, ('tcp: [10] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:47.518281 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f (non-flash) Jan 26 19:06:47.518281 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:06:47.518504 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsi session list stdout=tcp: [10] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f (non-flash) Jan 26 19:06:47.518504 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:06:47.519098 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Resulting device map defaultdict(. at 0x7fd7503afb00>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f'): ({'sda'}, set())}) {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:06:47.519494 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Removing single pathed devices sda {{(pid=189076) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:06:47.520284 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:47.524913 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:06:47.526420 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[8acd9cf8-851f-4373-89b8-5c527cea7c30]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:06:47.526420 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:06:47.526420 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:06:47.526420 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:06:47.526420 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:47.526420 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:06:47.526420 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:06:47.526420 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:47.526420 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:06:47.526420 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:06:47.526420 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:47.526420 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:06:47.526420 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:06:47.526420 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:47.526420 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:06:47.526420 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:06:47.526420 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:06:47.526420 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:06:47.526420 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:06:47.526420 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:06:47.526420 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:06:47.526420 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:06:47.528447 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acd9cf8-851f-4373-89b8-5c527cea7c30]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:47.528447 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Flushing IO for device /dev/sda {{(pid=189076) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:06:47.529120 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sda {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:47.535857 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sda" returned: 0 in 0.006s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:47.536138 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe90d02b-b724-43eb-8b59-c79dff7498f5]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:47.536553 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Remove SCSI device /dev/sda with /sys/block/sda/device/delete {{(pid=189076) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:06:47.537366 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sda/device/delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:47.591612 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sda/device/delete" returned: 0 in 0.053s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:47.591612 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4015a8-9d09-4213-bd46-382e91375cef]: (4, ('1', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:47.591612 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Checking to see if SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:06:47.591612 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:06:47.591612 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f')] {{(pid=189076) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:06:47.592617 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:47.599931 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:47.600932 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[8628abaf-0f2a-407a-9181-616589d8a2fd]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:47.601519 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:47.602649 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --logout {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:47.634580 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --logout" returned: 0 in 0.031s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:47.634580 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc328861-b3fb-4863-96c6-224760f7b8e5]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f, portal: 38.102.83.18,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:47.634580 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f, portal: 38.102.83.18,3260] Jan 26 19:06:47.634580 np0005596550.novalocal nova-compute[189076]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f, portal: 38.102.83.18,3260] successful. Jan 26 19:06:47.634580 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:47.637791 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:06:47.679946 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op delete" returned: 0 in 0.044s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:06:47.680247 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e473cc9-9a1d-4215-ad2b-00ccc9c7a742]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:06:47.680641 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:06:47.680953 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.195s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:06:47.681177 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] <== disconnect_volume: return (196ms) None {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:06:47.681403 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Disconnected iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jan 26 19:06:48.024327 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7376b80f-eb50-43d9-80d7-28e386cf60c1 req-a74f1983-4319-4c09-8c52-b2c689d846f6 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received event network-vif-unplugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:06:48.024759 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7376b80f-eb50-43d9-80d7-28e386cf60c1 req-a74f1983-4319-4c09-8c52-b2c689d846f6 service nova] Acquiring lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:48.025995 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7376b80f-eb50-43d9-80d7-28e386cf60c1 req-a74f1983-4319-4c09-8c52-b2c689d846f6 service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:48.026499 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7376b80f-eb50-43d9-80d7-28e386cf60c1 req-a74f1983-4319-4c09-8c52-b2c689d846f6 service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:48.027137 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7376b80f-eb50-43d9-80d7-28e386cf60c1 req-a74f1983-4319-4c09-8c52-b2c689d846f6 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] No waiting events found dispatching network-vif-unplugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:06:48.027700 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-7376b80f-eb50-43d9-80d7-28e386cf60c1 req-a74f1983-4319-4c09-8c52-b2c689d846f6 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received unexpected event network-vif-unplugged-0c5d371a-1c65-41be-864a-81be5995c568 for instance with vm_state resized and task_state resize_reverting. Jan 26 19:06:50.266595 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-59abe5ae-aea2-402f-bc2c-fd4db76bc956 req-d47cb375-da65-4690-9bae-9267dc2a844f service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received event network-vif-unplugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:06:50.267244 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-59abe5ae-aea2-402f-bc2c-fd4db76bc956 req-d47cb375-da65-4690-9bae-9267dc2a844f service nova] Acquiring lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:50.267720 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-59abe5ae-aea2-402f-bc2c-fd4db76bc956 req-d47cb375-da65-4690-9bae-9267dc2a844f service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:50.267982 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-59abe5ae-aea2-402f-bc2c-fd4db76bc956 req-d47cb375-da65-4690-9bae-9267dc2a844f service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:50.268279 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-59abe5ae-aea2-402f-bc2c-fd4db76bc956 req-d47cb375-da65-4690-9bae-9267dc2a844f service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] No waiting events found dispatching network-vif-unplugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:06:50.268530 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-59abe5ae-aea2-402f-bc2c-fd4db76bc956 req-d47cb375-da65-4690-9bae-9267dc2a844f service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received unexpected event network-vif-unplugged-0c5d371a-1c65-41be-864a-81be5995c568 for instance with vm_state resized and task_state resize_reverting. Jan 26 19:06:51.473940 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:51.474213 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:51.720450 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "b7041c4d-2e69-4988-bd5d-a9e302629220" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:51.720686 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "b7041c4d-2e69-4988-bd5d-a9e302629220" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:51.977072 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'migration_context' on Instance uuid c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:06:52.070474 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:52.223933 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:06:52.480915 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Object Instance lazy-loaded attributes: resources,migration_context {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:06:52.523142 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:52.790186 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:06:53.293717 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:06:53.356335 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:06:54.307542 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 2.833s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:54.317667 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.961s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:06:54.337717 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:06:54.338385 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Claim successful on node np0005596550.novalocal Jan 26 19:06:55.567301 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:06:56.071054 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:06:56.380979 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Swapping old allocation on dict_keys(['f627156c-932e-4a32-97b3-315a994a2ac9']) held by migration 314fc02f-7ffc-4f6d-af22-19ef9899c3b8 for instance Jan 26 19:06:56.431304 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Overwriting current allocation {'allocations': {'f627156c-932e-4a32-97b3-315a994a2ac9': {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}, 'generation': 99}}, 'project_id': '8428b9d1e48c42f690612bf1e012ec42', 'user_id': '8369268788c24337ade1739d948c300a', 'consumer_generation': 1} on consumer c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6 {{(pid=189076) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}} Jan 26 19:06:56.579911 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.262s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:06:56.581758 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:06:56.918931 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:57.072182 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:57.217187 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "refresh_cache-c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:06:57.217328 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquired lock "refresh_cache-c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:06:57.217491 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:06:57.524763 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:06:57.587922 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:06:57.588336 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:06:57.588336 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:57.588644 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:57.722594 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:06:57.754359 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9bb266354284323ae54b4c3317c26e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55032abafa74d4facac03929da4a366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:06:58.092876 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:06:58.595882 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:06:59.713739 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Successfully created port: 3ffd86c4-b487-449b-9277-55f5ae19d100 {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:07:00.107941 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:07:00.108819 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:07:00.109085 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Creating image(s) Jan 26 19:07:00.109539 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7041c4d-2e69-4988-bd5d-a9e302629220/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:00.109721 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "/opt/stack/data/nova/instances/b7041c4d-2e69-4988-bd5d-a9e302629220/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:00.110307 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "/opt/stack/data/nova/instances/b7041c4d-2e69-4988-bd5d-a9e302629220/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:00.110828 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:07:00.113407 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:07:00.114445 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:00.198513 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.083s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:00.199079 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:00.199596 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:00.200123 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:07:00.203729 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:07:00.204163 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:00.271320 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.067s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:00.271799 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/b7041c4d-2e69-4988-bd5d-a9e302629220/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:00.316330 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:00.825153 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/b7041c4d-2e69-4988-bd5d-a9e302629220/disk 1073741824" returned: 0 in 0.553s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:00.825986 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.626s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:00.827914 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:00.928011 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.101s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:00.928397 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7041c4d-2e69-4988-bd5d-a9e302629220/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:07:00.928661 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7041c4d-2e69-4988-bd5d-a9e302629220/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:01.007054 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7041c4d-2e69-4988-bd5d-a9e302629220/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:01.007633 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Cannot resize image /opt/stack/data/nova/instances/b7041c4d-2e69-4988-bd5d-a9e302629220/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:07:01.008315 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:07:01.008812 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Ensure instance console log exists: /opt/stack/data/nova/instances/b7041c4d-2e69-4988-bd5d-a9e302629220/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:07:01.009682 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:01.010395 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:01.010759 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:01.252396 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Successfully updated port: 3ffd86c4-b487-449b-9277-55f5ae19d100 {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:07:01.335802 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b9e1324e-fb74-45ee-be7a-66b9e81059a7 req-997ca53e-dc7e-4446-bf34-6cac418f494f service nova] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Received event network-changed-3ffd86c4-b487-449b-9277-55f5ae19d100 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:01.336178 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b9e1324e-fb74-45ee-be7a-66b9e81059a7 req-997ca53e-dc7e-4446-bf34-6cac418f494f service nova] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Refreshing instance network info cache due to event network-changed-3ffd86c4-b487-449b-9277-55f5ae19d100. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:07:01.336476 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b9e1324e-fb74-45ee-be7a-66b9e81059a7 req-997ca53e-dc7e-4446-bf34-6cac418f494f service nova] Acquiring lock "refresh_cache-b7041c4d-2e69-4988-bd5d-a9e302629220" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:07:01.336667 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b9e1324e-fb74-45ee-be7a-66b9e81059a7 req-997ca53e-dc7e-4446-bf34-6cac418f494f service nova] Acquired lock "refresh_cache-b7041c4d-2e69-4988-bd5d-a9e302629220" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:07:01.336961 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-b9e1324e-fb74-45ee-be7a-66b9e81059a7 req-997ca53e-dc7e-4446-bf34-6cac418f494f service nova] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Refreshing network info cache for port 3ffd86c4-b487-449b-9277-55f5ae19d100 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:07:01.528920 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Updating instance_info_cache with network_info: [{"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:07:01.755410 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "refresh_cache-b7041c4d-2e69-4988-bd5d-a9e302629220" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:07:01.839565 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-b9e1324e-fb74-45ee-be7a-66b9e81059a7 req-997ca53e-dc7e-4446-bf34-6cac418f494f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:01.949168 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:07:01.949307 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] VM Stopped (Lifecycle Event) Jan 26 19:07:02.005914 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-b9e1324e-fb74-45ee-be7a-66b9e81059a7 req-997ca53e-dc7e-4446-bf34-6cac418f494f service nova] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:07:02.033956 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Releasing lock "refresh_cache-c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:07:02.034678 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': True, 'host': 'np0005596550.novalocal', 'execute': None}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:07:02.035851 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:02.047793 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:02.047942 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f9cd61-1d5a-4d00-9bbd-3922f459fc38]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:02.049512 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[f0fa9bab-d57f-4e42-9db7-ff9e3cf42abf]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:07:02.049512 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:07:02.049512 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:07:02.049512 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:07:02.049512 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:07:02.049512 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:07:02.049512 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:07:02.049512 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:07:02.049512 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:07:02.049512 np0005596550.novalocal nova-compute[189076]: with open_scini_device() as fd: Jan 26 19:07:02.049512 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:07:02.049512 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:07:02.049512 np0005596550.novalocal nova-compute[189076]: return next(self.gen) Jan 26 19:07:02.049512 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^ Jan 26 19:07:02.049512 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:07:02.049512 np0005596550.novalocal nova-compute[189076]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:07:02.049512 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:07:02.049512 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:07:02.050079 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fa9bab-d57f-4e42-9db7-ff9e3cf42abf]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:02.050195 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.scaleio [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:07:02.050304 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.scaleio [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:07:02.051012 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:02.062583 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:02.062721 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60f4787-0523-4afe-a144-9ad82703efbe]: (4, ('/dev/vda2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:02.063939 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:02.073086 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:02.075079 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:02.075805 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[344a3a99-c93a-4188-a541-b72a0d600f55]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:02.078865 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7c9372-d49d-4893-9d03-d362dcc866d6]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:02.079523 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): nvme version {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:02.098548 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] 'nvme version' failed. Not Retrying. {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:07:02.099183 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] nvme not present on system {{(pid=189076) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:07:02.101785 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=189076) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:07:02.103901 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.lightos [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::64f3:a5ff:fe22:3e52', 'fe80::fc16:3eff:fe5d:9ebd', 'fe80::fc16:3eff:fe34:567b', 'fe80::9440:7dff:fe4f:8f89'] Jan 26 19:07:02.104232 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:07:02.104556 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:07:02.105147 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] <== get_connector_properties: return (70ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': True, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::64f3:a5ff:fe22:3e52', 'fe80::fc16:3eff:fe5d:9ebd', 'fe80::fc16:3eff:fe34:567b', 'fe80::9440:7dff:fe4f:8f89']} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:07:02.452414 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-f50762e0-eca0-40d3-a10e-6be378934c6e None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:02.472679 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-b9e1324e-fb74-45ee-be7a-66b9e81059a7 req-997ca53e-dc7e-4446-bf34-6cac418f494f service nova] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:07:02.526282 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:02.978021 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b9e1324e-fb74-45ee-be7a-66b9e81059a7 req-997ca53e-dc7e-4446-bf34-6cac418f494f service nova] Releasing lock "refresh_cache-b7041c4d-2e69-4988-bd5d-a9e302629220" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:07:02.978021 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquired lock "refresh_cache-b7041c4d-2e69-4988-bd5d-a9e302629220" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:07:02.978021 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:07:03.676853 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:07:03.884010 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:04.054033 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Updating instance_info_cache with network_info: [{"id": "3ffd86c4-b487-449b-9277-55f5ae19d100", "address": "fa:16:3e:46:b2:64", "network": {"id": "e3c16b95-f7e4-4902-8796-2e826827292b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093833914-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c55032abafa74d4facac03929da4a366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ffd86c4-b4", "ovs_interfaceid": "3ffd86c4-b487-449b-9277-55f5ae19d100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:07:04.562331 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Releasing lock "refresh_cache-b7041c4d-2e69-4988-bd5d-a9e302629220" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:07:04.562331 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Instance network_info: |[{"id": "3ffd86c4-b487-449b-9277-55f5ae19d100", "address": "fa:16:3e:46:b2:64", "network": {"id": "e3c16b95-f7e4-4902-8796-2e826827292b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093833914-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c55032abafa74d4facac03929da4a366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ffd86c4-b4", "ovs_interfaceid": "3ffd86c4-b487-449b-9277-55f5ae19d100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:07:04.566042 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Start _get_guest_xml network_info=[{"id": "3ffd86c4-b487-449b-9277-55f5ae19d100", "address": "fa:16:3e:46:b2:64", "network": {"id": "e3c16b95-f7e4-4902-8796-2e826827292b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093833914-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c55032abafa74d4facac03929da4a366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ffd86c4-b4", "ovs_interfaceid": "3ffd86c4-b487-449b-9277-55f5ae19d100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:07:04.575002 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:07:04.576728 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-118328640', uuid='b7041c4d-2e69-4988-bd5d-a9e302629220'), owner=OwnerMeta(userid='d9bb266354284323ae54b4c3317c26e5', username='tempest-VolumesSnapshotTestJSON-666453103-project-member', projectid='c55032abafa74d4facac03929da4a366', projectname='tempest-VolumesSnapshotTestJSON-666453103'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3ffd86c4-b487-449b-9277-55f5ae19d100", "address": "fa:16:3e:46:b2:64", "network": {"id": "e3c16b95-f7e4-4902-8796-2e826827292b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093833914-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c55032abafa74d4facac03929da4a366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ffd86c4-b4", "ovs_interfaceid": "3ffd86c4-b487-449b-9277-55f5ae19d100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472424.576261) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:07:04.578292 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:07:04.578802 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:07:04.580007 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:07:04.580552 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:07:04.581872 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:07:04.582400 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:07:04.583162 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:07:04.583423 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:07:04.583709 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:07:04.583981 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:07:04.584224 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:07:04.584595 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:07:04.584903 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:07:04.585190 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:07:04.585469 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:07:04.585745 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:07:04.589575 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-118328640',display_name='tempest-VolumesSnapshotTestJSON-instance-118328640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-volumessnapshottestjson-instance-118328640',id=73,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKt7+m1jFIoM2D12yrOKYafKjvfBS/DXB4r/HrHsnnMQ2LrFxR25amGpOF5S+AogjnRlNTno5u6QDqbOKgUvgJKYNKVepEuxR2qznLofXZ+/qoMbntpqVvclWMBSl1ekxg==',key_name='tempest-keypair-8186708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c55032abafa74d4facac03929da4a366',ramdisk_id='',reservation_id='r-g6faoujj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-666453103',owner_user_name='tempest-VolumesSnapshotTestJSON-666453103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:06:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9bb266354284323ae54b4c3317c26e5',uuid=b7041c4d-2e69-4988-bd5d-a9e302629220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ffd86c4-b487-449b-9277-55f5ae19d100", "address": "fa:16:3e:46:b2:64", "network": {"id": "e3c16b95-f7e4-4902-8796-2e826827292b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093833914-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c55032abafa74d4facac03929da4a366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ffd86c4-b4", "ovs_interfaceid": "3ffd86c4-b487-449b-9277-55f5ae19d100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:07:04.590110 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Converting VIF {"id": "3ffd86c4-b487-449b-9277-55f5ae19d100", "address": "fa:16:3e:46:b2:64", "network": {"id": "e3c16b95-f7e4-4902-8796-2e826827292b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093833914-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c55032abafa74d4facac03929da4a366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ffd86c4-b4", "ovs_interfaceid": "3ffd86c4-b487-449b-9277-55f5ae19d100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:07:04.590994 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:b2:64,bridge_name='br-int',has_traffic_filtering=True,id=3ffd86c4-b487-449b-9277-55f5ae19d100,network=Network(e3c16b95-f7e4-4902-8796-2e826827292b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ffd86c4-b4') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:07:04.591858 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lazy-loading 'pci_devices' on Instance uuid b7041c4d-2e69-4988-bd5d-a9e302629220 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] End _get_guest_xml xml= Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: b7041c4d-2e69-4988-bd5d-a9e302629220 Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: instance-00000049 Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: tempest-VolumesSnapshotTestJSON-instance-118328640 Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:07:04 Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: tempest-VolumesSnapshotTestJSON-666453103-project-member Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: tempest-VolumesSnapshotTestJSON-666453103 Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: b7041c4d-2e69-4988-bd5d-a9e302629220 Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: b7041c4d-2e69-4988-bd5d-a9e302629220 Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Preparing to wait for external event network-vif-plugged-3ffd86c4-b487-449b-9277-55f5ae19d100 {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "b7041c4d-2e69-4988-bd5d-a9e302629220-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:05.097889 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "b7041c4d-2e69-4988-bd5d-a9e302629220-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:05.104337 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "b7041c4d-2e69-4988-bd5d-a9e302629220-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.003s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:05.104337 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-118328640',display_name='tempest-VolumesSnapshotTestJSON-instance-118328640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-volumessnapshottestjson-instance-118328640',id=73,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKt7+m1jFIoM2D12yrOKYafKjvfBS/DXB4r/HrHsnnMQ2LrFxR25amGpOF5S+AogjnRlNTno5u6QDqbOKgUvgJKYNKVepEuxR2qznLofXZ+/qoMbntpqVvclWMBSl1ekxg==',key_name='tempest-keypair-8186708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c55032abafa74d4facac03929da4a366',ramdisk_id='',reservation_id='r-g6faoujj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-666453103',owner_user_name='tempest-VolumesSnapshotTestJSON-666453103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:06:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9bb266354284323ae54b4c3317c26e5',uuid=b7041c4d-2e69-4988-bd5d-a9e302629220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ffd86c4-b487-449b-9277-55f5ae19d100", "address": "fa:16:3e:46:b2:64", "network": {"id": "e3c16b95-f7e4-4902-8796-2e826827292b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093833914-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c55032abafa74d4facac03929da4a366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ffd86c4-b4", "ovs_interfaceid": "3ffd86c4-b487-449b-9277-55f5ae19d100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:07:05.104337 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Converting VIF {"id": "3ffd86c4-b487-449b-9277-55f5ae19d100", "address": "fa:16:3e:46:b2:64", "network": {"id": "e3c16b95-f7e4-4902-8796-2e826827292b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093833914-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c55032abafa74d4facac03929da4a366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ffd86c4-b4", "ovs_interfaceid": "3ffd86c4-b487-449b-9277-55f5ae19d100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:07:05.104646 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:b2:64,bridge_name='br-int',has_traffic_filtering=True,id=3ffd86c4-b487-449b-9277-55f5ae19d100,network=Network(e3c16b95-f7e4-4902-8796-2e826827292b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ffd86c4-b4') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:07:05.105091 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:b2:64,bridge_name='br-int',has_traffic_filtering=True,id=3ffd86c4-b487-449b-9277-55f5ae19d100,network=Network(e3c16b95-f7e4-4902-8796-2e826827292b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ffd86c4-b4') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:07:05.108048 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:05.108048 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:05.108048 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:07:05.111532 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:05.112435 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f6766a8-32f5-5bf6-9412-a91d6b8938d7', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:05.214466 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:05.216006 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:05.218501 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:05.218740 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ffd86c4-b4, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:05.219117 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ffd86c4-b4, col_values=(('qos', UUID('3278b0bd-0597-420e-ab74-bef48d93cfc8')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:05.219334 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ffd86c4-b4, col_values=(('external_ids', {'iface-id': '3ffd86c4-b487-449b-9277-55f5ae19d100', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:b2:64', 'vm-uuid': 'b7041c4d-2e69-4988-bd5d-a9e302629220'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:05.220230 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:05.222446 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:07:05.227138 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:05.228349 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:b2:64,bridge_name='br-int',has_traffic_filtering=True,id=3ffd86c4-b487-449b-9277-55f5ae19d100,network=Network(e3c16b95-f7e4-4902-8796-2e826827292b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ffd86c4-b4') Jan 26 19:07:05.412836 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0acc1c47-4fd7-4722-83a1-bae7e6a6c19d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "15a722c1-acc4-4b55-be3b-4f339ef40d15" by "nova.compute.manager.ComputeManager.stop_instance..do_stop_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:05.412836 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0acc1c47-4fd7-4722-83a1-bae7e6a6c19d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15" acquired by "nova.compute.manager.ComputeManager.stop_instance..do_stop_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:05.412836 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-0acc1c47-4fd7-4722-83a1-bae7e6a6c19d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:05.416333 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-0acc1c47-4fd7-4722-83a1-bae7e6a6c19d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=189076) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3483}} Jan 26 19:07:05.417157 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-0acc1c47-4fd7-4722-83a1-bae7e6a6c19d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'flavor' on Instance uuid 15a722c1-acc4-4b55-be3b-4f339ef40d15 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:07:06.452311 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:06.459366 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:06.461353 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:06.485055 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:06.502815 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:06.502815 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:06.687658 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Instance destroyed successfully. Jan 26 19:07:06.687954 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-0acc1c47-4fd7-4722-83a1-bae7e6a6c19d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'numa_topology' on Instance uuid 15a722c1-acc4-4b55-be3b-4f339ef40d15 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:07:06.870908 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:07:06.871066 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:07:06.871196 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] No VIF found with MAC fa:16:3e:46:b2:64, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:07:06.871704 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Using config drive Jan 26 19:07:07.076349 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:07.192304 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-0acc1c47-4fd7-4722-83a1-bae7e6a6c19d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Object Instance<15a722c1-acc4-4b55-be3b-4f339ef40d15> lazy-loaded attributes: flavor,numa_topology {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:07:07.192675 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-0acc1c47-4fd7-4722-83a1-bae7e6a6c19d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:07.204718 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c42cfe0d-b3f7-43ce-b0c6-6a35183a9185 req-9eab3743-217b-4574-90d9-c4555ed135e0 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received event network-vif-unplugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:07.205217 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c42cfe0d-b3f7-43ce-b0c6-6a35183a9185 req-9eab3743-217b-4574-90d9-c4555ed135e0 service nova] Acquiring lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:07.205579 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c42cfe0d-b3f7-43ce-b0c6-6a35183a9185 req-9eab3743-217b-4574-90d9-c4555ed135e0 service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:07.205961 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c42cfe0d-b3f7-43ce-b0c6-6a35183a9185 req-9eab3743-217b-4574-90d9-c4555ed135e0 service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:07.206236 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c42cfe0d-b3f7-43ce-b0c6-6a35183a9185 req-9eab3743-217b-4574-90d9-c4555ed135e0 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] No waiting events found dispatching network-vif-unplugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:07:07.206640 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-c42cfe0d-b3f7-43ce-b0c6-6a35183a9185 req-9eab3743-217b-4574-90d9-c4555ed135e0 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received unexpected event network-vif-unplugged-5cc84259-b85d-4859-ae79-2274980583af for instance with vm_state active and task_state powering-off. Jan 26 19:07:07.376836 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:07.590167 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Creating config drive at /opt/stack/data/nova/instances/b7041c4d-2e69-4988-bd5d-a9e302629220/disk.config Jan 26 19:07:07.597322 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/b7041c4d-2e69-4988-bd5d-a9e302629220/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp7gbiw_yc {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:07.709292 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0acc1c47-4fd7-4722-83a1-bae7e6a6c19d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15" "released" by "nova.compute.manager.ComputeManager.stop_instance..do_stop_instance" :: held 2.296s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:07.725762 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/b7041c4d-2e69-4988-bd5d-a9e302629220/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp7gbiw_yc" returned: 0 in 0.129s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:07.796340 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:07.819309 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:07.819309 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:07.843551 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Starting finish_revert_migration {{(pid=189076) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12813}} Jan 26 19:07:07.870841 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Start _get_guest_xml network_info=[{"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '2eba164a-b5bf-411a-8476-79a2f645ed12', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'target_lun': 0, 'volume_id': '8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'auth_method': 'CHAP', 'auth_username': 'DJGdCSYcXoX7W45zGsrh', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6', 'attached_at': '2026-01-27T00:07:06.000000', 'detached_at': '', 'volume_id': '8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'serial': '8ca88aff-367a-4ce7-9a74-4ca46af97c3f'}, 'boot_index': None, 'device_type': 'disk', 'volume_type': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:07:07.875231 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:07:07.876294 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1924433663', uuid='c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6'), owner=OwnerMeta(userid='8369268788c24337ade1739d948c300a', username='tempest-ServerActionsTestOtherB-1262198412-project-member', projectid='8428b9d1e48c42f690612bf1e012ec42', projectname='tempest-ServerActionsTestOtherB-1262198412'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472427.8759634) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:07:07.878430 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:07:07.878762 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:07:07.885301 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:07:07.885612 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:07:07.886797 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:07:07.887633 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:07:07.887838 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:07:07.888053 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:07:07.888284 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:07:07.888502 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:07:07.888698 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:07:07.889021 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:07:07.889257 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:07:07.889496 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:07:07.889649 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:07:07.889939 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:07:07.890218 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'vcpu_model' on Instance uuid c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:07:08.081854 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:08.103059 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:08.105608 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:08.110813 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:08.114513 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:07:08.114831 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] VM Started (Lifecycle Event) Jan 26 19:07:08.117196 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:08.395535 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk.config --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:08.485327 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk.config --force-share --output=json" returned: 0 in 0.089s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:08.485944 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "/opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:08.486623 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "/opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:08.487367 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "/opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:08.488093 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Calling os-brick to attach iSCSI Volume {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jan 26 19:07:08.489555 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'target_lun': 0, 'volume_id': '8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'auth_method': 'CHAP', 'auth_username': 'DJGdCSYcXoX7W45zGsrh', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:07:08.489951 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:07:08.490561 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:07:08.490914 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'target_lun': 0, 'volume_id': '8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'auth_method': 'CHAP', 'auth_username': 'DJGdCSYcXoX7W45zGsrh', 'auth_password': 'QYEGK4BnLv8mKnEB', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True} {{(pid=189076) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:07:08.492422 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:08.497419 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:07:08.497658 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[fd48af83-4f22-42b1-bc79-fc68114d47fd]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:07:08.497658 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:07:08.497658 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:07:08.497658 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:07:08.497658 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:07:08.497658 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:07:08.497658 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:07:08.497658 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:07:08.497658 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:07:08.497658 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:07:08.497658 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:07:08.497658 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:07:08.497658 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:07:08.497658 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:07:08.497658 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:07:08.497658 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:07:08.497658 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:07:08.497658 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:07:08.497658 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:07:08.497658 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:07:08.497658 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:07:08.497658 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:07:08.498438 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd48af83-4f22-42b1-bc79-fc68114d47fd]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:08.499310 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:07:08.499879 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:07:08.500883 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:07:08.501007 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:08.508959 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260" returned: 21 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:08.509197 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[f372ca8d-3c1b-4019-b65c-be9f8fe089c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:08.509679 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:07:08.509679 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:07:08.510493 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --interface default --op new {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:08.517279 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.006s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:08.517624 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbadac3d-3b00-4322-b346-0ae1f2faeee9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:08.518189 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f] added Jan 26 19:07:08.518189 np0005596550.novalocal nova-compute[189076]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:07:08.518189 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:07:08.518189 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:07:08.518189 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:07:08.518583 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=189076) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:07:08.519039 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.019(s), this was the 1st time calling it. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:07:08.519248 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:07:08.619804 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:08.626188 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:07:08.626359 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] VM Paused (Lifecycle Event) Jan 26 19:07:08.874819 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'flavor' on Instance uuid 15a722c1-acc4-4b55-be3b-4f339ef40d15 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:07:09.130857 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:09.133210 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:07:09.292946 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-afd106a9-26ce-4c18-b6e0-953936217c84 req-50b906c8-5dc0-49d9-9c5d-065c6b76fcdb service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received event network-vif-unplugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:09.293412 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-afd106a9-26ce-4c18-b6e0-953936217c84 req-50b906c8-5dc0-49d9-9c5d-065c6b76fcdb service nova] Acquiring lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:09.293935 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-afd106a9-26ce-4c18-b6e0-953936217c84 req-50b906c8-5dc0-49d9-9c5d-065c6b76fcdb service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:09.294358 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-afd106a9-26ce-4c18-b6e0-953936217c84 req-50b906c8-5dc0-49d9-9c5d-065c6b76fcdb service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:09.294858 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-afd106a9-26ce-4c18-b6e0-953936217c84 req-50b906c8-5dc0-49d9-9c5d-065c6b76fcdb service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] No waiting events found dispatching network-vif-unplugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:07:09.295229 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-afd106a9-26ce-4c18-b6e0-953936217c84 req-50b906c8-5dc0-49d9-9c5d-065c6b76fcdb service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received unexpected event network-vif-unplugged-5cc84259-b85d-4859-ae79-2274980583af for instance with vm_state stopped and task_state powering-on. Jan 26 19:07:09.300137 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-afd106a9-26ce-4c18-b6e0-953936217c84 req-50b906c8-5dc0-49d9-9c5d-065c6b76fcdb service nova] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Received event network-vif-plugged-3ffd86c4-b487-449b-9277-55f5ae19d100 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:09.300550 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-afd106a9-26ce-4c18-b6e0-953936217c84 req-50b906c8-5dc0-49d9-9c5d-065c6b76fcdb service nova] Acquiring lock "b7041c4d-2e69-4988-bd5d-a9e302629220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:09.301016 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-afd106a9-26ce-4c18-b6e0-953936217c84 req-50b906c8-5dc0-49d9-9c5d-065c6b76fcdb service nova] Lock "b7041c4d-2e69-4988-bd5d-a9e302629220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:09.301401 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-afd106a9-26ce-4c18-b6e0-953936217c84 req-50b906c8-5dc0-49d9-9c5d-065c6b76fcdb service nova] Lock "b7041c4d-2e69-4988-bd5d-a9e302629220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:09.301804 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-afd106a9-26ce-4c18-b6e0-953936217c84 req-50b906c8-5dc0-49d9-9c5d-065c6b76fcdb service nova] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Processing event network-vif-plugged-3ffd86c4-b487-449b-9277-55f5ae19d100 {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:07:09.302242 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-afd106a9-26ce-4c18-b6e0-953936217c84 req-50b906c8-5dc0-49d9-9c5d-065c6b76fcdb service nova] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Received event network-vif-plugged-3ffd86c4-b487-449b-9277-55f5ae19d100 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:09.302609 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-afd106a9-26ce-4c18-b6e0-953936217c84 req-50b906c8-5dc0-49d9-9c5d-065c6b76fcdb service nova] Acquiring lock "b7041c4d-2e69-4988-bd5d-a9e302629220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:09.304012 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-afd106a9-26ce-4c18-b6e0-953936217c84 req-50b906c8-5dc0-49d9-9c5d-065c6b76fcdb service nova] Lock "b7041c4d-2e69-4988-bd5d-a9e302629220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:09.304386 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-afd106a9-26ce-4c18-b6e0-953936217c84 req-50b906c8-5dc0-49d9-9c5d-065c6b76fcdb service nova] Lock "b7041c4d-2e69-4988-bd5d-a9e302629220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:09.304748 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-afd106a9-26ce-4c18-b6e0-953936217c84 req-50b906c8-5dc0-49d9-9c5d-065c6b76fcdb service nova] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] No waiting events found dispatching network-vif-plugged-3ffd86c4-b487-449b-9277-55f5ae19d100 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:07:09.305153 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-afd106a9-26ce-4c18-b6e0-953936217c84 req-50b906c8-5dc0-49d9-9c5d-065c6b76fcdb service nova] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Received unexpected event network-vif-plugged-3ffd86c4-b487-449b-9277-55f5ae19d100 for instance with vm_state building and task_state spawning. Jan 26 19:07:09.307471 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:07:09.312716 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:07:09.317629 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Instance spawned successfully. Jan 26 19:07:09.318291 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:07:09.382100 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "refresh_cache-15a722c1-acc4-4b55-be3b-4f339ef40d15" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:07:09.382100 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquired lock "refresh_cache-15a722c1-acc4-4b55-be3b-4f339ef40d15" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:07:09.382100 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:07:09.382100 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'info_cache' on Instance uuid 15a722c1-acc4-4b55-be3b-4f339ef40d15 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:07:09.520309 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:07:09.522543 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:09.531786 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:09.533218 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[539a4ef3-3d94-4b34-b250-ab7523399588]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.name = iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.tpgt = -1 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.startup = automatic Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.leading_login = No Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.iscsi_ifacename = default Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.net_ifacename = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.ipaddress = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.prefix_len = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.hwaddress = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.transport_name = tcp Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.initiatorname = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.state = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.vlan_id = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.vlan_priority = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.vlan_state = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.iface_num = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.mtu = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.port = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.bootproto = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.subnet_mask = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.gateway = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id_state = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.dhcp_dns = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.dhcp_learn_iqn = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.dhcp_req_vendor_id_state = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id_state = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.dhcp_slp_da = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.fragmentation = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.gratuitous_arp = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.incoming_forwarding = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.tos_state = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.tos = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.ttl = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.delayed_ack = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.tcp_nagle = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf_state = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.tcp_timer_scale = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.tcp_timestamp = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.redirect = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.def_task_mgmt_timeout = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.header_digest = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.data_digest = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.immediate_data = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.initial_r2t = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.data_seq_inorder = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.data_pdu_inorder = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.erl = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.max_receive_data_len = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.first_burst_len = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.max_outstanding_r2t = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.max_burst_len = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.chap_auth = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.bidi_chap = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.strict_login_compliance = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.discovery_auth = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: iface.discovery_logout = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.discovery_address = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.discovery_port = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.discovery_type = fw Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.initial_cmdsn = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.initial_login_retry_max = 8 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.xmit_thread_priority = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.cmds_max = 128 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.queue_depth = 32 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.nr_sessions = 1 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.auth.authmethod = None Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.auth.username = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.auth.password = *** Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.auth.username_in = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.auth.password_in = Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.timeo.replacement_timeout = 120 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FastAbort = Yes Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.InitialR2T = No Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ImmediateData = Yes Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxConnections = 1 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ERL = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.scan = auto Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.reopen_max = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.session.conn_reopen_log_freq = 1 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.conn[0].address = 38.102.83.18 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.conn[0].port = 3260 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.conn[0].startup = manual Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.window_size = 524288 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.DataDigest = None Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.IFMarker = No Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.OFMarker = No Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: # END RECORD Jan 26 19:07:09.534376 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:07:09.535730 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:09.543590 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:09.543747 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5059fb-801e-4055-8b5e-1688881401a9]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:09.544135 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:07:09.544728 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:09.555964 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:09.556083 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcf2f7a-75b4-4d56-a57e-94046e5d36f5]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:09.556474 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:07:09.557152 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.auth.username -v DJGdCSYcXoX7W45zGsrh {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:09.570006 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.auth.username -v DJGdCSYcXoX7W45zGsrh" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:09.570006 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e16b6e-e6a9-403b-8966-40353267a266]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:09.570006 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DJGdCSYcXoX7W45zGsrh'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:07:09.570006 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:09.578674 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:09.578674 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb52ce3-9f07-4705-8f77-fb854c80f31d]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:09.579144 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:07:09.579922 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:09.588176 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:09.588542 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[61416ab6-6a16-4705-b8c1-e2ab9496d2ca]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:09.588917 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jan 26 19:07:09.588917 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:07:09.589104 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jan 26 19:07:09.589104 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:07:09.589285 np0005596550.novalocal nova-compute[189076]: WARNING os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jan 26 19:07:09.589285 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:09.590339 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --login {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:09.605061 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --login" returned: 0 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:09.605061 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[19967a62-a0c2-4547-943f-666d4b32c5ae]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:09.605061 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f, portal: 38.102.83.18,3260] successful. Jan 26 19:07:09.605061 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:07:09.606031 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:09.616810 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:09.616810 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90c82ec-9912-4d21-bc57-fbb76c749f4e]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:09.616810 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:07:09.618287 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:09.628488 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:09.631641 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4597dc0d-19af-4051-806d-d86df6dc4612]: (4, ('tcp: [11] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:09.631641 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f (non-flash) Jan 26 19:07:09.631641 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:07:09.631641 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsi session list stdout=tcp: [11] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f (non-flash) Jan 26 19:07:09.631641 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:07:09.631641 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.131s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:07:09.631641 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Connected to 38.102.83.18:3260 {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:07:09.631641 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] HCTL ('2', '-', '-', 0) found on session 11 with lun 0 {{(pid=189076) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:07:09.631641 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Scanning host 2 c: -, t: -, l: 0) {{(pid=189076) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:07:09.632453 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host2/scan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:09.636292 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:07:09.636683 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:07:09.637042 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] VM Resumed (Lifecycle Event) Jan 26 19:07:09.648562 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host2/scan" returned: 0 in 0.015s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:09.648562 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[7048e8ec-9a78-4af9-b0b5-3a2b134b082a]: (4, ('- - 0', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:09.648562 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching for a device in session 11 and hctl ['2', '*', '*', 0] yield: None {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:07:09.829847 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:07:09.829847 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:07:09.829847 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:07:09.829847 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:07:09.829847 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:07:09.829847 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:07:09.887230 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Object Instance<15a722c1-acc4-4b55-be3b-4f339ef40d15> lazy-loaded attributes: flavor,info_cache {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:07:10.141552 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:10.144935 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:07:10.257722 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:10.339241 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Took 10.23 seconds to spawn the instance on the hypervisor. Jan 26 19:07:10.339241 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:10.388850 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:10.649203 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:07:10.649972 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching for a device in session 11 and hctl ['2', '*', '*', 0] yield: sda {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:07:10.650904 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Connected to sda using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'target_lun': 0, 'volume_id': '8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'auth_method': 'CHAP', 'auth_username': 'DJGdCSYcXoX7W45zGsrh', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True} {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:07:10.652565 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.162s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:07:10.652970 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] <== connect_volume: return (2163ms) {'type': 'block', 'scsi_wwn': '360014051a650fe7ac354c5cb11a9454f', 'path': '/dev/sda'} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:07:10.653650 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '360014051a650fe7ac354c5cb11a9454f', 'path': '/dev/sda'} {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jan 26 19:07:10.863460 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Took 17.63 seconds to build instance. Jan 26 19:07:10.933197 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:11.125864 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Updating instance_info_cache with network_info: [{"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:07:11.166500 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:05:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1924433663',display_name='tempest-ServerActionsTestOtherB-server-1924433663',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-1924433663',id=68,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK72/fZgFXc8Nm23qFp5bqxu5uQWjdqvi6tf0S8eHH5LAOejrjAG2pg3k7mvst6GtMR5cAEv++XPpoBWMRpc6kXyw3lb+Uukjxykolyr/SPF2WcEU8zRsEYayUYxi/WyQ==',key_name='tempest-keypair-56259378',keypairs=,launch_index=0,launched_at=2026-01-27T00:06:38Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-i9xjjhbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:06:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:07:11.166814 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:07:11.167477 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:de:3a,bridge_name='br-int',has_traffic_filtering=True,id=0c5d371a-1c65-41be-864a-81be5995c568,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5d371a-1c') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] End _get_guest_xml xml= Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6 Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: instance-00000044 Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-server-1924433663 Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:07:07 Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: ide Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: pc Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-1262198412-project-member Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-1262198412 Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6 Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6 Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: 8ca88aff-367a-4ce7-9a74-4ca46af97c3f Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:11.169309 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:07:11.172149 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Preparing to wait for external event network-vif-plugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:07:11.172149 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:11.172149 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:11.172149 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:11.172287 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:05:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1924433663',display_name='tempest-ServerActionsTestOtherB-server-1924433663',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-1924433663',id=68,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK72/fZgFXc8Nm23qFp5bqxu5uQWjdqvi6tf0S8eHH5LAOejrjAG2pg3k7mvst6GtMR5cAEv++XPpoBWMRpc6kXyw3lb+Uukjxykolyr/SPF2WcEU8zRsEYayUYxi/WyQ==',key_name='tempest-keypair-56259378',keypairs=,launch_index=0,launched_at=2026-01-27T00:06:38Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-i9xjjhbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:06:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:07:11.172287 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:07:11.172519 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:de:3a,bridge_name='br-int',has_traffic_filtering=True,id=0c5d371a-1c65-41be-864a-81be5995c568,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5d371a-1c') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:07:11.172519 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:de:3a,bridge_name='br-int',has_traffic_filtering=True,id=0c5d371a-1c65-41be-864a-81be5995c568,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5d371a-1c') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:07:11.172629 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:11.172987 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:11.173299 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:07:11.174088 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:11.174344 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea2c2523-d2d3-5ad2-ad14-3c5335468bcc', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:11.176085 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:11.177517 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:07:11.185618 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:11.188843 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:11.189215 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c5d371a-1c, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:11.189980 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c5d371a-1c, col_values=(('qos', UUID('5086a3df-f53f-4af0-ad4f-39a3589ce365')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:11.190366 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c5d371a-1c, col_values=(('external_ids', {'iface-id': '0c5d371a-1c65-41be-864a-81be5995c568', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:de:3a', 'vm-uuid': 'c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:11.192596 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:11.198067 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:07:11.206268 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:11.207620 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:de:3a,bridge_name='br-int',has_traffic_filtering=True,id=0c5d371a-1c65-41be-864a-81be5995c568,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5d371a-1c') Jan 26 19:07:11.369812 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-60c2c90d-877d-4bee-b27a-5ae1976a8f2b tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "b7041c4d-2e69-4988-bd5d-a9e302629220" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.647s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:11.422959 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:11.436694 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:11.448556 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:11.540736 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:11.549001 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:11.630368 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Releasing lock "refresh_cache-15a722c1-acc4-4b55-be3b-4f339ef40d15" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:07:11.646802 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:07:11.646802 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] VM Started (Lifecycle Event) Jan 26 19:07:11.705817 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-bffe44c7-ba59-4822-933f-18903d1f19ea req-4591c615-85fb-4c8d-81e4-2962cb84c419 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received event network-vif-plugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:11.705817 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-bffe44c7-ba59-4822-933f-18903d1f19ea req-4591c615-85fb-4c8d-81e4-2962cb84c419 service nova] Acquiring lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:11.705817 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-bffe44c7-ba59-4822-933f-18903d1f19ea req-4591c615-85fb-4c8d-81e4-2962cb84c419 service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:11.706893 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-bffe44c7-ba59-4822-933f-18903d1f19ea req-4591c615-85fb-4c8d-81e4-2962cb84c419 service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:11.707403 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-bffe44c7-ba59-4822-933f-18903d1f19ea req-4591c615-85fb-4c8d-81e4-2962cb84c419 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Processing event network-vif-plugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:07:11.710845 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:07:11.721336 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Instance running successfully. Jan 26 19:07:11.721932 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] finish_revert_migration finished successfully. {{(pid=189076) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12857}} Jan 26 19:07:12.077822 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:12.153968 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:12.159806 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:07:12.663790 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Instance destroyed successfully. Jan 26 19:07:12.664545 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'numa_topology' on Instance uuid 15a722c1-acc4-4b55-be3b-4f339ef40d15 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:07:12.669798 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] During sync_power_state the instance has a pending task (resize_reverting). Skip. Jan 26 19:07:12.669798 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:07:12.669798 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] VM Paused (Lifecycle Event) Jan 26 19:07:12.896153 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:07:12.967806 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-b127eb85-15f3-4c2d-9db2-82bc5d1ca993 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Updating instance to original state: 'active' Jan 26 19:07:13.178937 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:13.179245 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Object Instance<15a722c1-acc4-4b55-be3b-4f339ef40d15> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:07:13.179581 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'resources' on Instance uuid 15a722c1-acc4-4b55-be3b-4f339ef40d15 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:07:13.185113 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:07:13.185299 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] VM Resumed (Lifecycle Event) Jan 26 19:07:13.203965 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-73495bd7-2a2f-4df3-8489-00212d3848a7 req-994c85cb-3b52-4fc2-9ab6-a9854ca5be1d service nova] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Received event network-changed-3ffd86c4-b487-449b-9277-55f5ae19d100 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:13.204247 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-73495bd7-2a2f-4df3-8489-00212d3848a7 req-994c85cb-3b52-4fc2-9ab6-a9854ca5be1d service nova] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Refreshing instance network info cache due to event network-changed-3ffd86c4-b487-449b-9277-55f5ae19d100. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:07:13.204532 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-73495bd7-2a2f-4df3-8489-00212d3848a7 req-994c85cb-3b52-4fc2-9ab6-a9854ca5be1d service nova] Acquiring lock "refresh_cache-b7041c4d-2e69-4988-bd5d-a9e302629220" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:07:13.204782 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-73495bd7-2a2f-4df3-8489-00212d3848a7 req-994c85cb-3b52-4fc2-9ab6-a9854ca5be1d service nova] Acquired lock "refresh_cache-b7041c4d-2e69-4988-bd5d-a9e302629220" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:07:13.205095 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-73495bd7-2a2f-4df3-8489-00212d3848a7 req-994c85cb-3b52-4fc2-9ab6-a9854ca5be1d service nova] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Refreshing network info cache for port 3ffd86c4-b487-449b-9277-55f5ae19d100 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:07:13.405797 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:13.406148 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:13.406421 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:13.406688 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:07:13.682535 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Object Instance<15a722c1-acc4-4b55-be3b-4f339ef40d15> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:07:13.683888 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:06:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1024970397',display_name='tempest-ServerActionsTestJSON-server-1024970397',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestjson-server-1024970397',id=72,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaqJcAWtBvnDQt3Z0Zs2SEk8GmS4qswJn8I3pLNnZ26AiUp6izAb2VATu7Ta6RkUjooYd/ncwVnO6h5/K851Ht4DSyJ8eVOthZpoT3zQfgSsI2MjV6hMkI8XyrAdvV6PQ==',key_name='tempest-keypair-571396453',keypairs=,launch_index=0,launched_at=2026-01-27T00:06:27Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=4,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-ch4h3rbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=,task_state='powering-on',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=15a722c1-acc4-4b55-be3b-4f339ef40d15,vcpu_model=,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:07:13.685188 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:07:13.686906 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=5cc84259-b85d-4859-ae79-2274980583af,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc84259-b8') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:07:13.687387 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=5cc84259-b85d-4859-ae79-2274980583af,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc84259-b8') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:07:13.690917 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:13.691529 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:13.692236 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cc84259-b8, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:13.696822 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:13.697577 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:07:13.699188 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:13.701729 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:07:13.704450 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:13.704972 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e65a2e6-c8d7-485e-bf48-aa0c5b5a0405) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:13.709574 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:13.709574 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-73495bd7-2a2f-4df3-8489-00212d3848a7 req-994c85cb-3b52-4fc2-9ab6-a9854ca5be1d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:13.712597 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:13.746178 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=5cc84259-b85d-4859-ae79-2274980583af,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc84259-b8') Jan 26 19:07:13.757256 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Start _get_guest_xml network_info=[{"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:07:13.762598 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ebf0fe70-a52f-44cc-aa4c-8162c6a07066 req-6a44b60c-8b92-4062-a5c2-a6d86a62f847 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received event network-vif-plugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:13.762889 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ebf0fe70-a52f-44cc-aa4c-8162c6a07066 req-6a44b60c-8b92-4062-a5c2-a6d86a62f847 service nova] Acquiring lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:13.763083 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ebf0fe70-a52f-44cc-aa4c-8162c6a07066 req-6a44b60c-8b92-4062-a5c2-a6d86a62f847 service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:13.763292 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ebf0fe70-a52f-44cc-aa4c-8162c6a07066 req-6a44b60c-8b92-4062-a5c2-a6d86a62f847 service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:13.764447 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ebf0fe70-a52f-44cc-aa4c-8162c6a07066 req-6a44b60c-8b92-4062-a5c2-a6d86a62f847 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] No waiting events found dispatching network-vif-plugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:07:13.764613 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-ebf0fe70-a52f-44cc-aa4c-8162c6a07066 req-6a44b60c-8b92-4062-a5c2-a6d86a62f847 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received unexpected event network-vif-plugged-0c5d371a-1c65-41be-864a-81be5995c568 for instance with vm_state active and task_state None. Jan 26 19:07:13.768931 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:07:13.770296 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestJSON-server-1024970397', uuid='15a722c1-acc4-4b55-be3b-4f339ef40d15'), owner=OwnerMeta(userid='25c3c9ca754941ccbd986028c2a87e07', username='tempest-ServerActionsTestJSON-960489083-project-member', projectid='2efcb8570b994820a5956fab4e859054', projectname='tempest-ServerActionsTestJSON-960489083'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472433.7699027) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:07:13.771592 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:07:13.771984 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:07:13.773309 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:07:13.773964 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:07:13.774676 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:07:13.775019 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:07:13.775295 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:07:13.775463 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:07:13.775644 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:07:13.775809 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:07:13.775983 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:07:13.776191 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:07:13.776361 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:07:13.776536 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:07:13.776709 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:07:13.776907 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:07:13.777295 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'vcpu_model' on Instance uuid 15a722c1-acc4-4b55-be3b-4f339ef40d15 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:07:14.281461 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Object Instance<15a722c1-acc4-4b55-be3b-4f339ef40d15> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:07:14.284919 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk.config --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:14.349658 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-73495bd7-2a2f-4df3-8489-00212d3848a7 req-994c85cb-3b52-4fc2-9ab6-a9854ca5be1d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:14.397248 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk.config --force-share --output=json" returned: 0 in 0.111s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:14.397760 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "/opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:14.398364 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "/opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:14.402693 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "/opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.005s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:14.404417 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:06:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1024970397',display_name='tempest-ServerActionsTestJSON-server-1024970397',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestjson-server-1024970397',id=72,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaqJcAWtBvnDQt3Z0Zs2SEk8GmS4qswJn8I3pLNnZ26AiUp6izAb2VATu7Ta6RkUjooYd/ncwVnO6h5/K851Ht4DSyJ8eVOthZpoT3zQfgSsI2MjV6hMkI8XyrAdvV6PQ==',key_name='tempest-keypair-571396453',keypairs=,launch_index=0,launched_at=2026-01-27T00:06:27Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=4,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-ch4h3rbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=,task_state='powering-on',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=15a722c1-acc4-4b55-be3b-4f339ef40d15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:07:14.404690 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:07:14.405893 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=5cc84259-b85d-4859-ae79-2274980583af,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc84259-b8') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:07:14.409493 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'pci_devices' on Instance uuid 15a722c1-acc4-4b55-be3b-4f339ef40d15 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:07:14.449752 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Error from libvirt while getting description of instance-00000048: [Error Code 42] Domain not found: no domain with matching uuid '15a722c1-acc4-4b55-be3b-4f339ef40d15' (instance-00000048): libvirt.libvirtError: Domain not found: no domain with matching uuid '15a722c1-acc4-4b55-be3b-4f339ef40d15' (instance-00000048) Jan 26 19:07:14.454409 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7041c4d-2e69-4988-bd5d-a9e302629220/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:14.472051 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-73495bd7-2a2f-4df3-8489-00212d3848a7 req-994c85cb-3b52-4fc2-9ab6-a9854ca5be1d service nova] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Updated VIF entry in instance network info cache for port 3ffd86c4-b487-449b-9277-55f5ae19d100. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:07:14.472541 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-73495bd7-2a2f-4df3-8489-00212d3848a7 req-994c85cb-3b52-4fc2-9ab6-a9854ca5be1d service nova] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Updating instance_info_cache with network_info: [{"id": "3ffd86c4-b487-449b-9277-55f5ae19d100", "address": "fa:16:3e:46:b2:64", "network": {"id": "e3c16b95-f7e4-4902-8796-2e826827292b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093833914-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c55032abafa74d4facac03929da4a366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ffd86c4-b4", "ovs_interfaceid": "3ffd86c4-b487-449b-9277-55f5ae19d100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:07:14.540177 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7041c4d-2e69-4988-bd5d-a9e302629220/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:14.540467 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7041c4d-2e69-4988-bd5d-a9e302629220/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:14.627648 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7041c4d-2e69-4988-bd5d-a9e302629220/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:14.633645 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:14.702740 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk --force-share --output=json" returned: 0 in 0.069s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:14.703325 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:14.798940 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:14.799325 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] skipping disk /dev/sda (vdb) as it is a volume {{(pid=189076) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12209}} Jan 26 19:07:14.804843 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:14.894120 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:14.894120 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:14.920052 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Object Instance<15a722c1-acc4-4b55-be3b-4f339ef40d15> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] End _get_guest_xml xml= Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: 15a722c1-acc4-4b55-be3b-4f339ef40d15 Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: instance-00000048 Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestJSON-server-1024970397 Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:07:13 Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: ide Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: pc Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestJSON-960489083-project-member Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestJSON-960489083 Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: 15a722c1-acc4-4b55-be3b-4f339ef40d15 Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: 15a722c1-acc4-4b55-be3b-4f339ef40d15 Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:14.921387 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:07:14.926801 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:14.981361 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-73495bd7-2a2f-4df3-8489-00212d3848a7 req-994c85cb-3b52-4fc2-9ab6-a9854ca5be1d service nova] Releasing lock "refresh_cache-b7041c4d-2e69-4988-bd5d-a9e302629220" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:07:14.994202 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:15.017634 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:15.017634 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:15.134967 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:15.136731 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'trusted_certs' on Instance uuid 15a722c1-acc4-4b55-be3b-4f339ef40d15 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:07:15.182409 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:07:15.183585 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:15.200918 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.017s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:15.201248 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=7654MB free_disk=373.3663787841797GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:07:15.201415 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:15.201706 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:15.515568 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:15.516314 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:15.516314 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:15.516675 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:15.517012 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:15.521684 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Terminating instance Jan 26 19:07:15.639278 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Object Instance<15a722c1-acc4-4b55-be3b-4f339ef40d15> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:07:15.639681 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:15.728169 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.088s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:15.728478 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:07:15.728742 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:15.801011 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk --force-share --output=json" returned: 0 in 0.072s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:15.801297 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Cannot resize image /opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:07:15.801512 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'migration_context' on Instance uuid 15a722c1-acc4-4b55-be3b-4f339ef40d15 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:07:16.027372 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:07:16.065160 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:16.071312 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:16.191196 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:16.200237 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:16.294968 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance d0ddb554-76ed-49a6-a02b-042680eb310d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:07:16.294968 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:07:16.295134 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 15a722c1-acc4-4b55-be3b-4f339ef40d15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:07:16.295286 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance b7041c4d-2e69-4988-bd5d-a9e302629220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:07:16.295615 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 4 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:07:16.295761 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=1280MB phys_disk=399GB used_disk=4GB total_vcpus=8 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:07:15 up 35 min, 13 users, load average: 5.17, 5.01, 3.79\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '2', 'num_os_type_None': '4', 'num_proj_8428b9d1e48c42f690612bf1e012ec42': '2', 'io_workload': '0', 'num_task_deleting': '1', 'num_vm_stopped': '1', 'num_task_powering-on': '1', 'num_proj_2efcb8570b994820a5956fab4e859054': '1', 'num_proj_c55032abafa74d4facac03929da4a366': '1'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:07:16.313834 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Object Instance<15a722c1-acc4-4b55-be3b-4f339ef40d15> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:07:16.318800 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:06:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1024970397',display_name='tempest-ServerActionsTestJSON-server-1024970397',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestjson-server-1024970397',id=72,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaqJcAWtBvnDQt3Z0Zs2SEk8GmS4qswJn8I3pLNnZ26AiUp6izAb2VATu7Ta6RkUjooYd/ncwVnO6h5/K851Ht4DSyJ8eVOthZpoT3zQfgSsI2MjV6hMkI8XyrAdvV6PQ==',key_name='tempest-keypair-571396453',keypairs=,launch_index=0,launched_at=2026-01-27T00:06:27Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=,power_state=4,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-ch4h3rbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=15a722c1-acc4-4b55-be3b-4f339ef40d15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:07:16.318800 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:07:16.319185 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=5cc84259-b85d-4859-ae79-2274980583af,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc84259-b8') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:07:16.319185 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=5cc84259-b85d-4859-ae79-2274980583af,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc84259-b8') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:07:16.319185 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:16.319185 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:16.319185 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:07:16.319185 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:16.321049 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4cfab2be-052b-59c2-9eb6-01344db7600b', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:16.321049 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:16.323589 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:07:16.333855 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:16.338405 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:16.338980 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cc84259-b8, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:16.342820 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5cc84259-b8, col_values=(('qos', UUID('56ffb9a1-1cd4-4484-97db-0ce6f51d3ebf')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:16.342820 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5cc84259-b8, col_values=(('external_ids', {'iface-id': '5cc84259-b85d-4859-ae79-2274980583af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:56:7b', 'vm-uuid': '15a722c1-acc4-4b55-be3b-4f339ef40d15'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:16.351473 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:07:16.381220 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:16.382665 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=5cc84259-b85d-4859-ae79-2274980583af,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc84259-b8') Jan 26 19:07:16.385624 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Instance destroyed successfully. Jan 26 19:07:16.385954 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'resources' on Instance uuid c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:07:16.500201 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:16.511485 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:16.528149 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:07:16.670836 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for 15a722c1-acc4-4b55-be3b-4f339ef40d15 due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:07:16.671108 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:07:16.671358 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] VM Resumed (Lifecycle Event) Jan 26 19:07:16.676007 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Instance event wait completed in 0 seconds for {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:07:16.678279 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Instance rebooted successfully. Jan 26 19:07:16.734031 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-1152df1a-d432-4e30-9d9b-a4f012cfd932 req-270b7850-3b86-4e01-837a-e774f5071563 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received event network-vif-unplugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:16.734281 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1152df1a-d432-4e30-9d9b-a4f012cfd932 req-270b7850-3b86-4e01-837a-e774f5071563 service nova] Acquiring lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:16.735222 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1152df1a-d432-4e30-9d9b-a4f012cfd932 req-270b7850-3b86-4e01-837a-e774f5071563 service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:16.735222 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1152df1a-d432-4e30-9d9b-a4f012cfd932 req-270b7850-3b86-4e01-837a-e774f5071563 service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:16.735222 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-1152df1a-d432-4e30-9d9b-a4f012cfd932 req-270b7850-3b86-4e01-837a-e774f5071563 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] No waiting events found dispatching network-vif-unplugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:07:16.735222 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-1152df1a-d432-4e30-9d9b-a4f012cfd932 req-270b7850-3b86-4e01-837a-e774f5071563 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received event network-vif-unplugged-0c5d371a-1c65-41be-864a-81be5995c568 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:07:16.766400 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:16.773760 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:16.777802 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:16.782787 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:16.786969 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:16.889144 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:05:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1924433663',display_name='tempest-ServerActionsTestOtherB-server-1924433663',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-1924433663',id=68,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK72/fZgFXc8Nm23qFp5bqxu5uQWjdqvi6tf0S8eHH5LAOejrjAG2pg3k7mvst6GtMR5cAEv++XPpoBWMRpc6kXyw3lb+Uukjxykolyr/SPF2WcEU8zRsEYayUYxi/WyQ==',key_name='tempest-keypair-56259378',keypairs=,launch_index=0,launched_at=2026-01-27T00:07:12Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-i9xjjhbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:07:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:07:16.889389 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "0c5d371a-1c65-41be-864a-81be5995c568", "address": "fa:16:3e:5b:de:3a", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5d371a-1c", "ovs_interfaceid": "0c5d371a-1c65-41be-864a-81be5995c568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:07:16.890079 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:de:3a,bridge_name='br-int',has_traffic_filtering=True,id=0c5d371a-1c65-41be-864a-81be5995c568,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5d371a-1c') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:07:16.890410 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:de:3a,bridge_name='br-int',has_traffic_filtering=True,id=0c5d371a-1c65-41be-864a-81be5995c568,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5d371a-1c') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:07:16.897064 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:16.897372 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c5d371a-1c, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:16.900450 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:16.903384 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:07:16.904341 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:16.904695 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5086a3df-f53f-4af0-ad4f-39a3589ce365) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:16.909696 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:07:16.912831 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:de:3a,bridge_name='br-int',has_traffic_filtering=True,id=0c5d371a-1c65-41be-864a-81be5995c568,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5d371a-1c') Jan 26 19:07:16.914883 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] calling os-brick to detach iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jan 26 19:07:16.916053 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'target_lun': 0, 'volume_id': '8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 'auth_method': 'CHAP', 'auth_username': 'DJGdCSYcXoX7W45zGsrh', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sda'}, None), 'kwargs': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:07:16.916358 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:07:16.916969 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:07:16.918508 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:16.932376 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:16.932599 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[2426d00f-af44-4d8c-a102-32429e99e3a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:16.933179 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:07:16.933179 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:07:16.933179 np0005596550.novalocal nova-compute[189076]: iSNS: Jan 26 19:07:16.933179 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:07:16.933179 np0005596550.novalocal nova-compute[189076]: STATIC: Jan 26 19:07:16.933179 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f Jan 26 19:07:16.933179 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:07:16.933179 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:07:16.933179 np0005596550.novalocal nova-compute[189076]: FIRMWARE: Jan 26 19:07:16.933179 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:07:16.933179 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:07:16.933468 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:07:16.933468 np0005596550.novalocal nova-compute[189076]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:07:16.933468 np0005596550.novalocal nova-compute[189076]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=189076) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:07:16.934030 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f', 0)] {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:07:16.935804 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:16.946604 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:16.946604 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1694059-1766-49c8-bbba-8f3d0cdbbaf6]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:16.947994 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:16.964859 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.016s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:16.964859 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[5220db70-d9a5-47b8-aab8-d5de20aeeab1]: (4, ('tcp: [11] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:16.964859 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f (non-flash) Jan 26 19:07:16.964859 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:07:16.964979 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsi session list stdout=tcp: [11] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f (non-flash) Jan 26 19:07:16.964979 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:07:16.965590 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Resulting device map defaultdict(. at 0x7fd76b648400>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f'): ({'sda'}, set())}) {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:07:16.965879 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Removing single pathed devices sda {{(pid=189076) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:07:16.966917 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:16.976636 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:07:16.977131 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[4e677f32-f336-4d28-95dc-79d661350961]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:07:16.977131 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:07:16.977131 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:07:16.977131 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:07:16.977131 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:07:16.977131 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:07:16.977131 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:07:16.977131 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:07:16.977131 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:07:16.977131 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:07:16.977131 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:07:16.977131 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:07:16.977131 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:07:16.977131 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:07:16.977131 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:07:16.977131 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:07:16.977131 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:07:16.977131 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:07:16.977131 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:07:16.977131 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:07:16.977131 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:07:16.977131 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:07:16.977413 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e677f32-f336-4d28-95dc-79d661350961]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:16.978226 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Flushing IO for device /dev/sda {{(pid=189076) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:07:16.979222 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sda {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:16.987619 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sda" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:16.987840 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ca6954-96bf-4dcb-ace9-7520f8de747d]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:16.988284 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Remove SCSI device /dev/sda with /sys/block/sda/device/delete {{(pid=189076) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:07:16.992355 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sda/device/delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:17.037721 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:07:17.042662 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sda/device/delete" returned: 0 in 0.053s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:17.043013 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c284b02-6b0b-4352-957c-9f7d5abc415e]: (4, ('1', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:17.043604 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Checking to see if SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:07:17.043792 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:07:17.044058 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f')] {{(pid=189076) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:07:17.045424 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:17.057718 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:17.057800 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6d924e-161f-42a2-baf4-daae93492ccb]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:17.058326 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:07:17.059107 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --logout {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:17.079141 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:17.095059 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --logout" returned: 0 in 0.035s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:17.095059 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f874790-bb48-492b-afad-ad6eecee666e]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f, portal: 38.102.83.18,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:17.095334 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f, portal: 38.102.83.18,3260] Jan 26 19:07:17.095334 np0005596550.novalocal nova-compute[189076]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f, portal: 38.102.83.18,3260] successful. Jan 26 19:07:17.095334 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:07:17.096362 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:17.104244 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e3e4098d-34fd-43ae-8207-1fa25c677534 req-ac7f1873-51d3-4861-8173-057d5c8b9672 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received event network-vif-plugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:17.104381 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e3e4098d-34fd-43ae-8207-1fa25c677534 req-ac7f1873-51d3-4861-8173-057d5c8b9672 service nova] Acquiring lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:17.104633 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e3e4098d-34fd-43ae-8207-1fa25c677534 req-ac7f1873-51d3-4861-8173-057d5c8b9672 service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:17.104790 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e3e4098d-34fd-43ae-8207-1fa25c677534 req-ac7f1873-51d3-4861-8173-057d5c8b9672 service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:17.108002 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e3e4098d-34fd-43ae-8207-1fa25c677534 req-ac7f1873-51d3-4861-8173-057d5c8b9672 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] No waiting events found dispatching network-vif-plugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:07:17.108163 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-e3e4098d-34fd-43ae-8207-1fa25c677534 req-ac7f1873-51d3-4861-8173-057d5c8b9672 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received unexpected event network-vif-plugged-5cc84259-b85d-4859-ae79-2274980583af for instance with vm_state stopped and task_state powering-on. Jan 26 19:07:17.109174 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-8ca88aff-367a-4ce7-9a74-4ca46af97c3f -p 38.102.83.18:3260 --op delete" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:17.109276 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b88a3a-0455-478d-b064-4925df5708e1]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:17.109813 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:07:17.110039 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.193s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:07:17.110177 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] <== disconnect_volume: return (193ms) None {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:07:17.110320 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Disconnected iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jan 26 19:07:17.110643 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Deleting instance files /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6_del Jan 26 19:07:17.111320 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Deletion of /opt/stack/data/nova/instances/c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6_del complete Jan 26 19:07:17.177061 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:17.183212 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:07:17.475311 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:17.543839 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:07:17.544267 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.342s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:17.621722 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Took 1.59 seconds to destroy the instance on the hypervisor. Jan 26 19:07:17.621981 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:07:17.622155 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:07:17.622258 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:07:17.622514 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:17.666578 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:17.777669 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] During sync_power_state the instance has a pending task (powering-on). Skip. Jan 26 19:07:17.781006 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:07:17.781006 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] VM Started (Lifecycle Event) Jan 26 19:07:18.285503 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:18.292099 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:07:18.292421 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:07:18.292698 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] No VIF found with MAC fa:16:3e:34:56:7b, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:07:18.297172 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c8532c8f-09e5-4fa8-b61e-7087b57ccaae tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:18.298226 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:07:18.801587 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] During sync_power_state the instance has a pending task (powering-on). Skip. Jan 26 19:07:18.822733 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:07:18.837786 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e12ff276-0479-442e-a386-242c8e5a4caa req-6f7ef3fb-e751-450a-b1d3-3296f841483d service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received event network-vif-unplugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:18.837786 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e12ff276-0479-442e-a386-242c8e5a4caa req-6f7ef3fb-e751-450a-b1d3-3296f841483d service nova] Acquiring lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:18.838001 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e12ff276-0479-442e-a386-242c8e5a4caa req-6f7ef3fb-e751-450a-b1d3-3296f841483d service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:18.838191 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e12ff276-0479-442e-a386-242c8e5a4caa req-6f7ef3fb-e751-450a-b1d3-3296f841483d service nova] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:18.838377 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e12ff276-0479-442e-a386-242c8e5a4caa req-6f7ef3fb-e751-450a-b1d3-3296f841483d service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] No waiting events found dispatching network-vif-unplugged-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:07:18.838564 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e12ff276-0479-442e-a386-242c8e5a4caa req-6f7ef3fb-e751-450a-b1d3-3296f841483d service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received event network-vif-unplugged-0c5d371a-1c65-41be-864a-81be5995c568 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:07:19.150838 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4085711d-3652-4ca5-9101-7d961899cac8 req-bbcf0289-5abd-45fc-8a4a-18589e685ec2 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received event network-vif-plugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:19.150838 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4085711d-3652-4ca5-9101-7d961899cac8 req-bbcf0289-5abd-45fc-8a4a-18589e685ec2 service nova] Acquiring lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:19.150838 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4085711d-3652-4ca5-9101-7d961899cac8 req-bbcf0289-5abd-45fc-8a4a-18589e685ec2 service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:19.150838 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4085711d-3652-4ca5-9101-7d961899cac8 req-bbcf0289-5abd-45fc-8a4a-18589e685ec2 service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:19.151042 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4085711d-3652-4ca5-9101-7d961899cac8 req-bbcf0289-5abd-45fc-8a4a-18589e685ec2 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] No waiting events found dispatching network-vif-plugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:07:19.151180 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-4085711d-3652-4ca5-9101-7d961899cac8 req-bbcf0289-5abd-45fc-8a4a-18589e685ec2 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received unexpected event network-vif-plugged-5cc84259-b85d-4859-ae79-2274980583af for instance with vm_state active and task_state None. Jan 26 19:07:19.151340 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4085711d-3652-4ca5-9101-7d961899cac8 req-bbcf0289-5abd-45fc-8a4a-18589e685ec2 service nova] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Received event network-vif-deleted-0c5d371a-1c65-41be-864a-81be5995c568 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:19.325607 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Took 1.70 seconds to deallocate network for instance. Jan 26 19:07:19.543290 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:07:19.543446 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:07:19.543572 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:07:19.543703 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:07:20.892244 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:07:20.894956 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:07:20.895092 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:07:20.991073 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-0b875adb-6914-4492-b5e2-6dbb9e6c3ac9 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'pci_devices' on Instance uuid 15a722c1-acc4-4b55-be3b-4f339ef40d15 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:07:21.505930 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:07:21.505930 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] VM Paused (Lifecycle Event) Jan 26 19:07:21.891831 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:07:21.895674 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:07:21.906346 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:21.959206 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:21.989581 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:22.000904 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:22.008312 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:22.079951 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:22.151871 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:22.167011 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:22.212834 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-0b875adb-6914-4492-b5e2-6dbb9e6c3ac9 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:22.438951 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6ef72dfb-bd9a-4b8a-926a-df738091e594 req-387f8102-f91f-47fe-9626-29c149841715 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received event network-vif-unplugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:22.439118 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6ef72dfb-bd9a-4b8a-926a-df738091e594 req-387f8102-f91f-47fe-9626-29c149841715 service nova] Acquiring lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:22.439277 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6ef72dfb-bd9a-4b8a-926a-df738091e594 req-387f8102-f91f-47fe-9626-29c149841715 service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:22.439409 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6ef72dfb-bd9a-4b8a-926a-df738091e594 req-387f8102-f91f-47fe-9626-29c149841715 service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:22.439532 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6ef72dfb-bd9a-4b8a-926a-df738091e594 req-387f8102-f91f-47fe-9626-29c149841715 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] No waiting events found dispatching network-vif-unplugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:07:22.439672 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-6ef72dfb-bd9a-4b8a-926a-df738091e594 req-387f8102-f91f-47fe-9626-29c149841715 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received unexpected event network-vif-unplugged-5cc84259-b85d-4859-ae79-2274980583af for instance with vm_state active and task_state suspending. Jan 26 19:07:22.547963 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Took 3.22 seconds to detach 1 volumes for instance. Jan 26 19:07:23.056946 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:23.057354 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:23.309235 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:07:23.816161 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:07:24.235719 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-c2ffc025-dbda-4902-a088-58ded08c586d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Resuming Jan 26 19:07:24.236686 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c2ffc025-dbda-4902-a088-58ded08c586d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'flavor' on Instance uuid 15a722c1-acc4-4b55-be3b-4f339ef40d15 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:07:24.325680 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.268s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:24.432468 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Deleted allocations for instance c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6 Jan 26 19:07:24.498449 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6b5bb128-77de-4082-9867-d2ef1d7db731 req-63b50bee-bb22-4c5f-b1d6-13100c61ed2c service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received event network-vif-unplugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:24.498677 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6b5bb128-77de-4082-9867-d2ef1d7db731 req-63b50bee-bb22-4c5f-b1d6-13100c61ed2c service nova] Acquiring lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:24.500328 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6b5bb128-77de-4082-9867-d2ef1d7db731 req-63b50bee-bb22-4c5f-b1d6-13100c61ed2c service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:24.500328 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6b5bb128-77de-4082-9867-d2ef1d7db731 req-63b50bee-bb22-4c5f-b1d6-13100c61ed2c service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:24.500328 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6b5bb128-77de-4082-9867-d2ef1d7db731 req-63b50bee-bb22-4c5f-b1d6-13100c61ed2c service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] No waiting events found dispatching network-vif-unplugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:07:24.500328 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-6b5bb128-77de-4082-9867-d2ef1d7db731 req-63b50bee-bb22-4c5f-b1d6-13100c61ed2c service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received unexpected event network-vif-unplugged-5cc84259-b85d-4859-ae79-2274980583af for instance with vm_state suspended and task_state resuming. Jan 26 19:07:25.445616 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-37467f1d-d779-4e82-98db-a6b63c9f62d1 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 9.930s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:25.747847 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c2ffc025-dbda-4902-a088-58ded08c586d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "refresh_cache-15a722c1-acc4-4b55-be3b-4f339ef40d15" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:07:25.748126 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c2ffc025-dbda-4902-a088-58ded08c586d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquired lock "refresh_cache-15a722c1-acc4-4b55-be3b-4f339ef40d15" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:07:25.748420 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-c2ffc025-dbda-4902-a088-58ded08c586d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:07:26.251581 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-c2ffc025-dbda-4902-a088-58ded08c586d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:26.776896 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-c2ffc025-dbda-4902-a088-58ded08c586d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:26.909416 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:26.919848 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-c2ffc025-dbda-4902-a088-58ded08c586d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Updating instance_info_cache with network_info: [{"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:07:27.081529 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:27.424671 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c2ffc025-dbda-4902-a088-58ded08c586d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Releasing lock "refresh_cache-15a722c1-acc4-4b55-be3b-4f339ef40d15" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:07:27.429582 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-c2ffc025-dbda-4902-a088-58ded08c586d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:06:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1024970397',display_name='tempest-ServerActionsTestJSON-server-1024970397',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestjson-server-1024970397',id=72,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaqJcAWtBvnDQt3Z0Zs2SEk8GmS4qswJn8I3pLNnZ26AiUp6izAb2VATu7Ta6RkUjooYd/ncwVnO6h5/K851Ht4DSyJ8eVOthZpoT3zQfgSsI2MjV6hMkI8XyrAdvV6PQ==',key_name='tempest-keypair-571396453',keypairs=,launch_index=0,launched_at=2026-01-27T00:06:27Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=4,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-ch4h3rbw',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=,task_state='resuming',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:07:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=15a722c1-acc4-4b55-be3b-4f339ef40d15,vcpu_model=,vcpus=1,vm_mode=None,vm_state='suspended') vif={"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:07:27.429973 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c2ffc025-dbda-4902-a088-58ded08c586d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:07:27.431095 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c2ffc025-dbda-4902-a088-58ded08c586d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=5cc84259-b85d-4859-ae79-2274980583af,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc84259-b8') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:07:27.431746 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-c2ffc025-dbda-4902-a088-58ded08c586d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=5cc84259-b85d-4859-ae79-2274980583af,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc84259-b8') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:07:27.432435 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:27.433389 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:27.433389 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:07:27.436373 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:27.436795 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cc84259-b8, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:27.437121 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5cc84259-b8, col_values=(('external_ids', {'iface-id': '5cc84259-b85d-4859-ae79-2274980583af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:56:7b', 'vm-uuid': '15a722c1-acc4-4b55-be3b-4f339ef40d15'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:27.437720 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:07:27.438399 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-c2ffc025-dbda-4902-a088-58ded08c586d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=5cc84259-b85d-4859-ae79-2274980583af,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc84259-b8') Jan 26 19:07:27.459615 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c2ffc025-dbda-4902-a088-58ded08c586d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'numa_topology' on Instance uuid 15a722c1-acc4-4b55-be3b-4f339ef40d15 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:07:27.963429 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-c2ffc025-dbda-4902-a088-58ded08c586d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Object Instance<15a722c1-acc4-4b55-be3b-4f339ef40d15> lazy-loaded attributes: flavor,numa_topology {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:07:28.104401 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:28.121552 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:28.261417 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:28.265090 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:28.326339 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f00795ff-e066-40f8-87a1-7dcb3fb91f87 req-d2a65ac8-4cdc-4d71-b4f9-9892ed4d521f service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received event network-vif-plugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:28.326485 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f00795ff-e066-40f8-87a1-7dcb3fb91f87 req-d2a65ac8-4cdc-4d71-b4f9-9892ed4d521f service nova] Acquiring lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:28.326729 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f00795ff-e066-40f8-87a1-7dcb3fb91f87 req-d2a65ac8-4cdc-4d71-b4f9-9892ed4d521f service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:28.327588 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f00795ff-e066-40f8-87a1-7dcb3fb91f87 req-d2a65ac8-4cdc-4d71-b4f9-9892ed4d521f service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:28.327588 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f00795ff-e066-40f8-87a1-7dcb3fb91f87 req-d2a65ac8-4cdc-4d71-b4f9-9892ed4d521f service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] No waiting events found dispatching network-vif-plugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:07:28.327588 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-f00795ff-e066-40f8-87a1-7dcb3fb91f87 req-d2a65ac8-4cdc-4d71-b4f9-9892ed4d521f service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received unexpected event network-vif-plugged-5cc84259-b85d-4859-ae79-2274980583af for instance with vm_state suspended and task_state resuming. Jan 26 19:07:28.332151 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for 15a722c1-acc4-4b55-be3b-4f339ef40d15 due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:07:28.332151 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:07:28.332151 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] VM Started (Lifecycle Event) Jan 26 19:07:28.345062 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c2ffc025-dbda-4902-a088-58ded08c586d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Instance event wait completed in 0 seconds for {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:07:28.345290 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c2ffc025-dbda-4902-a088-58ded08c586d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'pci_devices' on Instance uuid 15a722c1-acc4-4b55-be3b-4f339ef40d15 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:07:28.441410 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:28.444240 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:28.447159 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:28.449502 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:28.451792 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:28.769142 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:07:28.837037 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:28.841993 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Synchronizing instance power state after lifecycle event "Started"; current vm_state: suspended, current task_state: resuming, current DB power_state: 4, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:07:28.851531 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-c2ffc025-dbda-4902-a088-58ded08c586d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Object Instance<15a722c1-acc4-4b55-be3b-4f339ef40d15> lazy-loaded attributes: flavor,numa_topology,pci_devices {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:07:28.854602 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Instance running successfully. Jan 26 19:07:28.855543 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-c2ffc025-dbda-4902-a088-58ded08c586d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Failed to set time: agent not configured {{(pid=189076) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}} Jan 26 19:07:28.855697 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c2ffc025-dbda-4902-a088-58ded08c586d tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:29.314255 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:29.314876 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:29.327572 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:07:29.328227 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Claim successful on node np0005596550.novalocal Jan 26 19:07:29.346896 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] During sync_power_state the instance has a pending task (resuming). Skip. Jan 26 19:07:29.346896 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:07:29.346896 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] VM Resumed (Lifecycle Event) Jan 26 19:07:29.856288 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:29.865755 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:07:30.142925 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "15a722c1-acc4-4b55-be3b-4f339ef40d15" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:30.143001 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:30.143339 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:30.143623 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:30.143623 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:30.145957 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Terminating instance Jan 26 19:07:30.371488 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] During sync_power_state the instance has a pending task (deleting). Skip. Jan 26 19:07:30.382643 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-945e5433-34c4-4ff5-b7ae-18089217a7fa req-892d168b-825f-4a2d-897f-b500d7319fa6 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received event network-vif-plugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:30.382643 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-945e5433-34c4-4ff5-b7ae-18089217a7fa req-892d168b-825f-4a2d-897f-b500d7319fa6 service nova] Acquiring lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:30.382784 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-945e5433-34c4-4ff5-b7ae-18089217a7fa req-892d168b-825f-4a2d-897f-b500d7319fa6 service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:30.383023 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-945e5433-34c4-4ff5-b7ae-18089217a7fa req-892d168b-825f-4a2d-897f-b500d7319fa6 service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:30.383222 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-945e5433-34c4-4ff5-b7ae-18089217a7fa req-892d168b-825f-4a2d-897f-b500d7319fa6 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] No waiting events found dispatching network-vif-plugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:07:30.383421 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-945e5433-34c4-4ff5-b7ae-18089217a7fa req-892d168b-825f-4a2d-897f-b500d7319fa6 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received unexpected event network-vif-plugged-5cc84259-b85d-4859-ae79-2274980583af for instance with vm_state active and task_state deleting. Jan 26 19:07:30.534390 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:07:30.649809 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:07:30.675524 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:30.680253 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:30.699990 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:30.709265 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:30.888581 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:30.897597 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:30.948634 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Instance destroyed successfully. Jan 26 19:07:30.948921 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lazy-loading 'resources' on Instance uuid 15a722c1-acc4-4b55-be3b-4f339ef40d15 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:07:31.037961 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:07:31.351828 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:07:31.351828 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] VM Stopped (Lifecycle Event) Jan 26 19:07:31.452368 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:06:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1024970397',display_name='tempest-ServerActionsTestJSON-server-1024970397',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestjson-server-1024970397',id=72,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaqJcAWtBvnDQt3Z0Zs2SEk8GmS4qswJn8I3pLNnZ26AiUp6izAb2VATu7Ta6RkUjooYd/ncwVnO6h5/K851Ht4DSyJ8eVOthZpoT3zQfgSsI2MjV6hMkI8XyrAdvV6PQ==',key_name='tempest-keypair-571396453',keypairs=,launch_index=0,launched_at=2026-01-27T00:06:27Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='2efcb8570b994820a5956fab4e859054',ramdisk_id='',reservation_id='r-ch4h3rbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-960489083',owner_user_name='tempest-ServerActionsTestJSON-960489083-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:07:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c3c9ca754941ccbd986028c2a87e07',uuid=15a722c1-acc4-4b55-be3b-4f339ef40d15,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:07:31.452874 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converting VIF {"id": "5cc84259-b85d-4859-ae79-2274980583af", "address": "fa:16:3e:34:56:7b", "network": {"id": "501c82ef-5869-4876-b4db-9d1ac2b70b9d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1812167825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efcb8570b994820a5956fab4e859054", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc84259-b8", "ovs_interfaceid": "5cc84259-b85d-4859-ae79-2274980583af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:07:31.453377 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=5cc84259-b85d-4859-ae79-2274980583af,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc84259-b8') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:07:31.453544 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=5cc84259-b85d-4859-ae79-2274980583af,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc84259-b8') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:07:31.455191 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:31.455404 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cc84259-b8, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:31.458317 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:31.460396 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:07:31.460900 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:31.461090 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56ffb9a1-1cd4-4484-97db-0ce6f51d3ebf) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:31.461754 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:31.464452 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:07:31.465995 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=5cc84259-b85d-4859-ae79-2274980583af,network=Network(501c82ef-5869-4876-b4db-9d1ac2b70b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc84259-b8') Jan 26 19:07:31.466312 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Deleting instance files /opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15_del Jan 26 19:07:31.466928 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Deletion of /opt/stack/data/nova/instances/15a722c1-acc4-4b55-be3b-4f339ef40d15_del complete Jan 26 19:07:31.548316 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.234s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:31.548668 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:07:31.853085 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-66dde5b3-570d-472b-8bb8-0e0bb2fc0a3a None None] [instance: c13ca111-e7f6-41c6-9d5c-402d2d0ec2a6] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:31.983420 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Took 1.33 seconds to destroy the instance on the hypervisor. Jan 26 19:07:31.984156 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:07:31.984673 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:07:31.985050 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:07:31.985409 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:32.054694 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:07:32.055148 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:07:32.055455 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:32.055729 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:32.083903 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:32.119310 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:32.137060 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8369268788c24337ade1739d948c300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428b9d1e48c42f690612bf1e012ec42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:07:32.436565 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a5128028-cf89-4eec-8023-80fca4b2177e req-2c369124-8f64-4ec7-bbdd-a89f450b1bcd service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received event network-vif-unplugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:32.436565 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a5128028-cf89-4eec-8023-80fca4b2177e req-2c369124-8f64-4ec7-bbdd-a89f450b1bcd service nova] Acquiring lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:32.436565 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a5128028-cf89-4eec-8023-80fca4b2177e req-2c369124-8f64-4ec7-bbdd-a89f450b1bcd service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:32.436565 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a5128028-cf89-4eec-8023-80fca4b2177e req-2c369124-8f64-4ec7-bbdd-a89f450b1bcd service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:32.436725 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a5128028-cf89-4eec-8023-80fca4b2177e req-2c369124-8f64-4ec7-bbdd-a89f450b1bcd service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] No waiting events found dispatching network-vif-unplugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:07:32.437241 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a5128028-cf89-4eec-8023-80fca4b2177e req-2c369124-8f64-4ec7-bbdd-a89f450b1bcd service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received event network-vif-unplugged-5cc84259-b85d-4859-ae79-2274980583af for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:07:32.437468 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a5128028-cf89-4eec-8023-80fca4b2177e req-2c369124-8f64-4ec7-bbdd-a89f450b1bcd service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received event network-vif-unplugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:32.437824 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a5128028-cf89-4eec-8023-80fca4b2177e req-2c369124-8f64-4ec7-bbdd-a89f450b1bcd service nova] Acquiring lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:32.438332 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a5128028-cf89-4eec-8023-80fca4b2177e req-2c369124-8f64-4ec7-bbdd-a89f450b1bcd service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:32.438532 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a5128028-cf89-4eec-8023-80fca4b2177e req-2c369124-8f64-4ec7-bbdd-a89f450b1bcd service nova] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:32.438953 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a5128028-cf89-4eec-8023-80fca4b2177e req-2c369124-8f64-4ec7-bbdd-a89f450b1bcd service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] No waiting events found dispatching network-vif-unplugged-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:07:32.439923 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a5128028-cf89-4eec-8023-80fca4b2177e req-2c369124-8f64-4ec7-bbdd-a89f450b1bcd service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received event network-vif-unplugged-5cc84259-b85d-4859-ae79-2274980583af for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:07:32.576207 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:07:32.652357 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-332bdd3a-a88b-460c-8f8c-7c983f7f41ea req-cdcc1e5a-f705-4b30-a19c-337add87b263 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Received event network-vif-deleted-5cc84259-b85d-4859-ae79-2274980583af {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:32.652531 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-332bdd3a-a88b-460c-8f8c-7c983f7f41ea req-cdcc1e5a-f705-4b30-a19c-337add87b263 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Neutron deleted interface 5cc84259-b85d-4859-ae79-2274980583af; detaching it from the instance and deleting it from the info cache Jan 26 19:07:32.652679 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-332bdd3a-a88b-460c-8f8c-7c983f7f41ea req-cdcc1e5a-f705-4b30-a19c-337add87b263 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:07:32.655927 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Successfully created port: 8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:07:33.083790 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:07:33.121613 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:07:33.161449 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-332bdd3a-a88b-460c-8f8c-7c983f7f41ea req-cdcc1e5a-f705-4b30-a19c-337add87b263 service nova] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Detach interface failed, port_id=5cc84259-b85d-4859-ae79-2274980583af, reason: Instance 15a722c1-acc4-4b55-be3b-4f339ef40d15 could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:07:33.203827 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Successfully updated port: 8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:07:33.626144 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Took 1.64 seconds to deallocate network for instance. Jan 26 19:07:33.706500 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "refresh_cache-86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:07:33.709007 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquired lock "refresh_cache-86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:07:33.709007 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:07:34.099338 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:07:34.101190 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:07:34.101951 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Creating image(s) Jan 26 19:07:34.103448 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "/opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:34.104136 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "/opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:34.105813 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "/opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:34.108072 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:07:34.114256 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:07:34.118825 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:34.140819 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:34.140819 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:34.262187 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.145s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:34.263193 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:34.263863 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:34.265199 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:07:34.269657 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:07:34.270187 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:34.336366 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:07:34.364698 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.094s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:34.377055 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:34.417858 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk 1073741824" returned: 0 in 0.039s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:34.417858 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.153s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:34.417858 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:34.434189 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:07:34.500408 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:34.518163 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.100s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:34.518331 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:07:34.518555 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:34.591449 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk --force-share --output=json" returned: 0 in 0.072s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:34.591834 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Cannot resize image /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:07:34.592259 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:07:34.592446 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Ensure instance console log exists: /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:07:34.592856 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:34.593134 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:34.593301 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:34.645801 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Updating instance_info_cache with network_info: [{"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:07:34.690619 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-37ea1762-0c94-4071-a5f5-335d7b7753c7 req-b8cf1918-b4f2-475f-97d3-50daed9ca8a3 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Received event network-changed-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:34.693380 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-37ea1762-0c94-4071-a5f5-335d7b7753c7 req-b8cf1918-b4f2-475f-97d3-50daed9ca8a3 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Refreshing instance network info cache due to event network-changed-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:07:34.693380 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-37ea1762-0c94-4071-a5f5-335d7b7753c7 req-b8cf1918-b4f2-475f-97d3-50daed9ca8a3 service nova] Acquiring lock "refresh_cache-86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:07:34.943967 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:07:35.149484 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Releasing lock "refresh_cache-86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:07:35.149918 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Instance network_info: |[{"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:07:35.150823 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-37ea1762-0c94-4071-a5f5-335d7b7753c7 req-b8cf1918-b4f2-475f-97d3-50daed9ca8a3 service nova] Acquired lock "refresh_cache-86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:07:35.150823 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-37ea1762-0c94-4071-a5f5-335d7b7753c7 req-b8cf1918-b4f2-475f-97d3-50daed9ca8a3 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Refreshing network info cache for port 8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:07:35.153568 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Start _get_guest_xml network_info=[{"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:07:35.160941 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:07:35.160941 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-979228963', uuid='86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa'), owner=OwnerMeta(userid='8369268788c24337ade1739d948c300a', username='tempest-ServerActionsTestOtherB-1262198412-project-member', projectid='8428b9d1e48c42f690612bf1e012ec42', projectname='tempest-ServerActionsTestOtherB-1262198412'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472455.1606183) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:07:35.164636 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:07:35.164983 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:07:35.167010 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:07:35.167349 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:07:35.168245 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:07:35.168593 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:07:35.168755 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:07:35.168902 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:07:35.169052 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:07:35.169170 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:07:35.169294 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:07:35.169468 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:07:35.169596 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:07:35.169763 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:07:35.169912 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:07:35.170050 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:07:35.173062 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:07:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-979228963',display_name='tempest-ServerActionsTestOtherB-server-979228963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-979228963',id=74,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK72/fZgFXc8Nm23qFp5bqxu5uQWjdqvi6tf0S8eHH5LAOejrjAG2pg3k7mvst6GtMR5cAEv++XPpoBWMRpc6kXyw3lb+Uukjxykolyr/SPF2WcEU8zRsEYayUYxi/WyQ==',key_name='tempest-keypair-56259378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-bfui779d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:07:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:07:35.174129 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:07:35.174129 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:03:06,bridge_name='br-int',has_traffic_filtering=True,id=8de29cf0-d7bc-4d33-9f3c-a793ec1426ad,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de29cf0-d7') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:07:35.174307 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'pci_devices' on Instance uuid 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:07:35.454310 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.314s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:35.504896 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Deleted allocations for instance 15a722c1-acc4-4b55-be3b-4f339ef40d15 Jan 26 19:07:35.655827 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-37ea1762-0c94-4071-a5f5-335d7b7753c7 req-b8cf1918-b4f2-475f-97d3-50daed9ca8a3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] End _get_guest_xml xml= Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: instance-0000004a Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-server-979228963 Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:07:35 Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-1262198412-project-member Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-1262198412 Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:35.678298 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:07:35.680139 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Preparing to wait for external event network-vif-plugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:07:35.680139 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:35.680139 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:35.680139 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:35.680244 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:07:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-979228963',display_name='tempest-ServerActionsTestOtherB-server-979228963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-979228963',id=74,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK72/fZgFXc8Nm23qFp5bqxu5uQWjdqvi6tf0S8eHH5LAOejrjAG2pg3k7mvst6GtMR5cAEv++XPpoBWMRpc6kXyw3lb+Uukjxykolyr/SPF2WcEU8zRsEYayUYxi/WyQ==',key_name='tempest-keypair-56259378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-bfui779d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:07:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:07:35.680886 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:07:35.681109 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:03:06,bridge_name='br-int',has_traffic_filtering=True,id=8de29cf0-d7bc-4d33-9f3c-a793ec1426ad,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de29cf0-d7') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:07:35.682025 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:03:06,bridge_name='br-int',has_traffic_filtering=True,id=8de29cf0-d7bc-4d33-9f3c-a793ec1426ad,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de29cf0-d7') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:07:35.682025 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:35.682543 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:35.682732 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:07:35.683530 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:35.683754 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f896bf4-3dba-5fd9-bda2-81bb98738b88', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:35.722685 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:35.728136 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:35.746092 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:35.746381 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8de29cf0-d7, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:35.746963 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8de29cf0-d7, col_values=(('qos', UUID('b74c9a33-6c8e-42ce-9bd1-18e5c9ec07d2')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:35.747252 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8de29cf0-d7, col_values=(('external_ids', {'iface-id': '8de29cf0-d7bc-4d33-9f3c-a793ec1426ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:03:06', 'vm-uuid': '86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:35.749557 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:35.753789 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:07:35.758808 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:35.759629 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:03:06,bridge_name='br-int',has_traffic_filtering=True,id=8de29cf0-d7bc-4d33-9f3c-a793ec1426ad,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de29cf0-d7') Jan 26 19:07:35.932273 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-37ea1762-0c94-4071-a5f5-335d7b7753c7 req-b8cf1918-b4f2-475f-97d3-50daed9ca8a3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:36.056638 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-37ea1762-0c94-4071-a5f5-335d7b7753c7 req-b8cf1918-b4f2-475f-97d3-50daed9ca8a3 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Updated VIF entry in instance network info cache for port 8de29cf0-d7bc-4d33-9f3c-a793ec1426ad. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:07:36.057048 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-37ea1762-0c94-4071-a5f5-335d7b7753c7 req-b8cf1918-b4f2-475f-97d3-50daed9ca8a3 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Updating instance_info_cache with network_info: [{"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:07:36.518971 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2b590ae2-96d2-40bf-bf42-250f9742e328 tempest-ServerActionsTestJSON-960489083 tempest-ServerActionsTestJSON-960489083-project-member] Lock "15a722c1-acc4-4b55-be3b-4f339ef40d15" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.376s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:36.560040 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-37ea1762-0c94-4071-a5f5-335d7b7753c7 req-b8cf1918-b4f2-475f-97d3-50daed9ca8a3 service nova] Releasing lock "refresh_cache-86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:07:37.089611 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:37.283031 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:07:37.283175 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:07:37.283299 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No VIF found with MAC fa:16:3e:3b:03:06, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:07:37.283741 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Using config drive Jan 26 19:07:37.793104 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:37.901196 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Creating config drive at /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk.config Jan 26 19:07:37.909022 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmprxtprpat {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:38.048698 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmprxtprpat" returned: 0 in 0.139s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:38.125364 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:38.139397 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:38.292298 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:38.293580 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:38.333740 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:07:38.334411 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] VM Started (Lifecycle Event) Jan 26 19:07:38.354271 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e7e7b47c-9ea4-48a7-b2bb-f69b3261620f req-ba3d5a03-6a84-4269-bd0d-135eef59e540 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Received event network-vif-plugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:38.354478 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e7e7b47c-9ea4-48a7-b2bb-f69b3261620f req-ba3d5a03-6a84-4269-bd0d-135eef59e540 service nova] Acquiring lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:38.354663 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e7e7b47c-9ea4-48a7-b2bb-f69b3261620f req-ba3d5a03-6a84-4269-bd0d-135eef59e540 service nova] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:38.354888 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e7e7b47c-9ea4-48a7-b2bb-f69b3261620f req-ba3d5a03-6a84-4269-bd0d-135eef59e540 service nova] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:38.355038 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e7e7b47c-9ea4-48a7-b2bb-f69b3261620f req-ba3d5a03-6a84-4269-bd0d-135eef59e540 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Processing event network-vif-plugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:07:38.358753 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:07:38.362842 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:07:38.370685 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Instance spawned successfully. Jan 26 19:07:38.370965 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:07:38.842547 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:38.844912 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:07:38.891310 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:07:38.891644 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:07:38.892684 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:07:38.893228 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:07:38.894581 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:07:38.895220 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:07:39.352551 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:07:39.352551 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:07:39.353120 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] VM Paused (Lifecycle Event) Jan 26 19:07:39.403606 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Took 5.31 seconds to spawn the instance on the hypervisor. Jan 26 19:07:39.404037 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:39.806737 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:39.856844 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:39.865517 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:07:39.865663 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] VM Resumed (Lifecycle Event) Jan 26 19:07:39.921826 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Took 10.65 seconds to build instance. Jan 26 19:07:40.378330 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:40.389947 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:07:40.425198 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-611c60ad-e5fd-425a-a74d-51167fb42ac9 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 12.163s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:40.448448 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-0a868284-ceb4-4f48-925a-41b59f129a4e req-9a10e0a6-87fe-4c46-aa48-a6c2b4056f15 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Received event network-vif-plugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:40.448448 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-0a868284-ceb4-4f48-925a-41b59f129a4e req-9a10e0a6-87fe-4c46-aa48-a6c2b4056f15 service nova] Acquiring lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:40.448448 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-0a868284-ceb4-4f48-925a-41b59f129a4e req-9a10e0a6-87fe-4c46-aa48-a6c2b4056f15 service nova] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:40.450814 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-0a868284-ceb4-4f48-925a-41b59f129a4e req-9a10e0a6-87fe-4c46-aa48-a6c2b4056f15 service nova] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:40.450814 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-0a868284-ceb4-4f48-925a-41b59f129a4e req-9a10e0a6-87fe-4c46-aa48-a6c2b4056f15 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] No waiting events found dispatching network-vif-plugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:07:40.450814 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-0a868284-ceb4-4f48-925a-41b59f129a4e req-9a10e0a6-87fe-4c46-aa48-a6c2b4056f15 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Received unexpected event network-vif-plugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad for instance with vm_state active and task_state None. Jan 26 19:07:40.749820 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:42.092041 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:42.588966 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-9524ed36-a3c8-42cd-8a53-139df02398a8 req-f4d1073e-d68d-454c-b06b-6392d09d0594 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Received event network-changed-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:42.588966 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-9524ed36-a3c8-42cd-8a53-139df02398a8 req-f4d1073e-d68d-454c-b06b-6392d09d0594 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Refreshing instance network info cache due to event network-changed-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:07:42.589129 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-9524ed36-a3c8-42cd-8a53-139df02398a8 req-f4d1073e-d68d-454c-b06b-6392d09d0594 service nova] Acquiring lock "refresh_cache-86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:07:42.589297 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-9524ed36-a3c8-42cd-8a53-139df02398a8 req-f4d1073e-d68d-454c-b06b-6392d09d0594 service nova] Acquired lock "refresh_cache-86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:07:42.589494 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-9524ed36-a3c8-42cd-8a53-139df02398a8 req-f4d1073e-d68d-454c-b06b-6392d09d0594 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Refreshing network info cache for port 8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:07:43.094007 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-9524ed36-a3c8-42cd-8a53-139df02398a8 req-f4d1073e-d68d-454c-b06b-6392d09d0594 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:43.406648 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-9524ed36-a3c8-42cd-8a53-139df02398a8 req-f4d1073e-d68d-454c-b06b-6392d09d0594 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:43.498310 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-9524ed36-a3c8-42cd-8a53-139df02398a8 req-f4d1073e-d68d-454c-b06b-6392d09d0594 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Updated VIF entry in instance network info cache for port 8de29cf0-d7bc-4d33-9f3c-a793ec1426ad. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:07:43.498688 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-9524ed36-a3c8-42cd-8a53-139df02398a8 req-f4d1073e-d68d-454c-b06b-6392d09d0594 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Updating instance_info_cache with network_info: [{"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:07:44.002520 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-9524ed36-a3c8-42cd-8a53-139df02398a8 req-f4d1073e-d68d-454c-b06b-6392d09d0594 service nova] Releasing lock "refresh_cache-86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:07:45.044568 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:45.750220 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:45.948004 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:07:45.948390 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] VM Stopped (Lifecycle Event) Jan 26 19:07:46.453243 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ac601a34-c217-4658-83d8-fe1544661f56 None None] [instance: 15a722c1-acc4-4b55-be3b-4f339ef40d15] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:07:47.094434 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:47.531362 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:49.389837 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "b7041c4d-2e69-4988-bd5d-a9e302629220" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:49.390212 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "b7041c4d-2e69-4988-bd5d-a9e302629220" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:49.446266 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Acquiring lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:49.446521 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:49.897649 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lazy-loading 'flavor' on Instance uuid b7041c4d-2e69-4988-bd5d-a9e302629220 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:07:49.950799 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:07:50.400903 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Ignoring supplied device name: /dev/vdb Jan 26 19:07:50.488342 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:50.488547 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:50.494607 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:07:50.494607 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Claim successful on node np0005596550.novalocal Jan 26 19:07:50.753464 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:50.909165 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "b7041c4d-2e69-4988-bd5d-a9e302629220" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.518s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:51.723382 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:07:52.007068 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "b7041c4d-2e69-4988-bd5d-a9e302629220" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:52.007068 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "b7041c4d-2e69-4988-bd5d-a9e302629220" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:52.007359 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Attaching volume 45ac36d4-0d45-4d42-8723-1353aae47e05 to /dev/vdb Jan 26 19:07:52.066790 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': True, 'host': 'np0005596550.novalocal', 'execute': None}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:07:52.068241 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:52.076184 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:52.076184 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21f231a-fda8-442a-86e7-2e8463665296]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:52.078952 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[4e5d1f19-007c-4e16-97ab-4183d9b6b11f]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:07:52.078952 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:07:52.078952 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:07:52.078952 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:07:52.078952 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:07:52.078952 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:07:52.078952 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:07:52.078952 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:07:52.078952 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:07:52.078952 np0005596550.novalocal nova-compute[189076]: with open_scini_device() as fd: Jan 26 19:07:52.078952 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:07:52.078952 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:07:52.078952 np0005596550.novalocal nova-compute[189076]: return next(self.gen) Jan 26 19:07:52.078952 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^ Jan 26 19:07:52.078952 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:07:52.078952 np0005596550.novalocal nova-compute[189076]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:07:52.078952 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:07:52.078952 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:07:52.078952 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5d1f19-007c-4e16-97ab-4183d9b6b11f]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:52.078952 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.scaleio [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:07:52.078952 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.scaleio [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:07:52.080511 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:52.091292 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:52.091527 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[9054e717-8b3a-4d95-950b-073564c4537b]: (4, ('/dev/vda2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:52.092439 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:52.096391 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:52.100402 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:52.100662 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e88cbf6-c4a5-451d-94ec-c90b71038341]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:52.102255 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf892039-372d-41b3-91b0-c908db7d1f49]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:52.102685 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Running cmd (subprocess): nvme version {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:52.120459 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] 'nvme version' failed. Not Retrying. {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:07:52.120711 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] nvme not present on system {{(pid=189076) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:07:52.122167 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=189076) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:07:52.123003 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.lightos [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::64f3:a5ff:fe22:3e52', 'fe80::fc16:3eff:fe5d:9ebd', 'fe80::fc16:3eff:fe46:b264', 'fe80::90ca:8ff:fe97:c364', 'fe80::fc16:3eff:fe3b:306'] Jan 26 19:07:52.123128 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:07:52.123297 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:07:52.123632 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] <== get_connector_properties: return (56ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': True, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::64f3:a5ff:fe22:3e52', 'fe80::fc16:3eff:fe5d:9ebd', 'fe80::fc16:3eff:fe46:b264', 'fe80::90ca:8ff:fe97:c364', 'fe80::fc16:3eff:fe3b:306']} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:07:52.123898 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.block_device [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Updating existing volume attachment record: 751bc286-8f12-4b77-996d-71b7a6814584 {{(pid=189076) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jan 26 19:07:52.228602 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:07:52.740696 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.252s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:52.741956 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:07:53.257687 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:07:53.262914 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:07:53.262914 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:53.262914 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:53.351027 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '87970c72a3184e05adfff584170d6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71dbd6f9d5b41cbb2491c5735419ee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:07:53.788827 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:07:53.873788 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Successfully created port: 45acff40-a26b-4b33-a063-9d37ec161b50 {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:07:54.292149 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:07:54.342543 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Successfully updated port: 45acff40-a26b-4b33-a063-9d37ec161b50 {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:07:54.382222 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-59b7b0c4-50c8-4830-9ae6-994ae8f59e12 req-35a66748-3a4b-49f3-adf7-75accde7d025 service nova] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Received event network-changed-45acff40-a26b-4b33-a063-9d37ec161b50 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:07:54.382222 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-59b7b0c4-50c8-4830-9ae6-994ae8f59e12 req-35a66748-3a4b-49f3-adf7-75accde7d025 service nova] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Refreshing instance network info cache due to event network-changed-45acff40-a26b-4b33-a063-9d37ec161b50. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:07:54.382222 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-59b7b0c4-50c8-4830-9ae6-994ae8f59e12 req-35a66748-3a4b-49f3-adf7-75accde7d025 service nova] Acquiring lock "refresh_cache-b45e5bd0-6b91-4999-bfb3-df0d0e355d77" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:07:54.382222 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-59b7b0c4-50c8-4830-9ae6-994ae8f59e12 req-35a66748-3a4b-49f3-adf7-75accde7d025 service nova] Acquired lock "refresh_cache-b45e5bd0-6b91-4999-bfb3-df0d0e355d77" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:07:54.387315 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-59b7b0c4-50c8-4830-9ae6-994ae8f59e12 req-35a66748-3a4b-49f3-adf7-75accde7d025 service nova] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Refreshing network info cache for port 45acff40-a26b-4b33-a063-9d37ec161b50 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:07:54.851696 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Acquiring lock "refresh_cache-b45e5bd0-6b91-4999-bfb3-df0d0e355d77" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:07:54.889415 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-59b7b0c4-50c8-4830-9ae6-994ae8f59e12 req-35a66748-3a4b-49f3-adf7-75accde7d025 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:54.961792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-59b7b0c4-50c8-4830-9ae6-994ae8f59e12 req-35a66748-3a4b-49f3-adf7-75accde7d025 service nova] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:07:55.106371 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-59b7b0c4-50c8-4830-9ae6-994ae8f59e12 req-35a66748-3a4b-49f3-adf7-75accde7d025 service nova] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:07:55.302701 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:07:55.304901 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:07:55.305431 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Creating image(s) Jan 26 19:07:55.306143 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Acquiring lock "/opt/stack/data/nova/instances/b45e5bd0-6b91-4999-bfb3-df0d0e355d77/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:55.306551 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Lock "/opt/stack/data/nova/instances/b45e5bd0-6b91-4999-bfb3-df0d0e355d77/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:55.307456 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Lock "/opt/stack/data/nova/instances/b45e5bd0-6b91-4999-bfb3-df0d0e355d77/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:55.309180 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:07:55.314162 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:07:55.316223 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:55.406866 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.090s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:55.407363 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:55.407957 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:55.408552 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:07:55.412447 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:07:55.412908 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:55.501084 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.088s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:55.501489 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/b45e5bd0-6b91-4999-bfb3-df0d0e355d77/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:55.610798 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-59b7b0c4-50c8-4830-9ae6-994ae8f59e12 req-35a66748-3a4b-49f3-adf7-75accde7d025 service nova] Releasing lock "refresh_cache-b45e5bd0-6b91-4999-bfb3-df0d0e355d77" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:07:55.611782 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Acquired lock "refresh_cache-b45e5bd0-6b91-4999-bfb3-df0d0e355d77" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:07:55.611782 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:07:55.625300 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/b45e5bd0-6b91-4999-bfb3-df0d0e355d77/disk 1073741824" returned: 0 in 0.124s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:55.625664 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.218s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:55.626337 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:55.706838 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.079s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:55.707270 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b45e5bd0-6b91-4999-bfb3-df0d0e355d77/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:07:55.707584 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45e5bd0-6b91-4999-bfb3-df0d0e355d77/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:55.753260 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:55.809933 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45e5bd0-6b91-4999-bfb3-df0d0e355d77/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:55.810344 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Cannot resize image /opt/stack/data/nova/instances/b45e5bd0-6b91-4999-bfb3-df0d0e355d77/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:07:55.810737 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:07:55.810995 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Ensure instance console log exists: /opt/stack/data/nova/instances/b45e5bd0-6b91-4999-bfb3-df0d0e355d77/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:07:55.811373 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:55.811655 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:55.811890 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:56.193921 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Calling os-brick to attach iSCSI Volume {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jan 26 19:07:56.194681 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05', 'target_lun': 0, 'volume_id': '45ac36d4-0d45-4d42-8723-1353aae47e05', 'auth_method': 'CHAP', 'auth_username': 'Scs6TyYAxWX4riLALM2P', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:07:56.194880 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:07:56.195236 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:07:56.195379 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05', 'target_lun': 0, 'volume_id': '45ac36d4-0d45-4d42-8723-1353aae47e05', 'auth_method': 'CHAP', 'auth_username': 'Scs6TyYAxWX4riLALM2P', 'auth_password': 'h3KRx6AGqb6Fnjbj', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True} {{(pid=189076) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:07:56.197536 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:56.201257 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:07:56.216417 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:07:56.216504 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[c4dae830-c323-4282-8544-ade8a856a405]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:07:56.216504 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:07:56.216504 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:07:56.216504 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:07:56.216504 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:07:56.216504 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:07:56.216504 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:07:56.216504 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:07:56.216504 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:07:56.216504 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:07:56.216504 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:07:56.216504 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:07:56.216504 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:07:56.216504 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:07:56.216504 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:07:56.216504 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:07:56.216504 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:07:56.216504 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:07:56.216504 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:07:56.216504 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:07:56.216504 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:07:56.216504 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:07:56.216916 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dae830-c323-4282-8544-ade8a856a405]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:56.217189 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:07:56.217609 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:07:56.217759 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:07:56.219427 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:56.232000 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260" returned: 21 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:56.232174 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15d395a-3875-43e8-be3d-c5c9aa12b5e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:56.232586 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:07:56.232586 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:07:56.234303 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260 --interface default --op new {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:56.265477 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:56.265710 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4e90b3-3883-4374-8ab5-a118786ed3f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:56.266513 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05] added Jan 26 19:07:56.266513 np0005596550.novalocal nova-compute[189076]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:07:56.266513 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:07:56.266513 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:07:56.266513 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:07:56.266855 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=189076) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:07:56.267368 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.049(s), this was the 1st time calling it. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:07:56.267749 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:07:56.363235 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:56.527012 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Updating instance_info_cache with network_info: [{"id": "45acff40-a26b-4b33-a063-9d37ec161b50", "address": "fa:16:3e:77:42:d7", "network": {"id": "c84eb370-cb9f-4ac9-8ec5-c18123b64612", "bridge": "br-int", "label": "tempest-ServerMetadataTestJSON-2005128381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d71dbd6f9d5b41cbb2491c5735419ee1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45acff40-a2", "ovs_interfaceid": "45acff40-a26b-4b33-a063-9d37ec161b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:07:57.034236 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Releasing lock "refresh_cache-b45e5bd0-6b91-4999-bfb3-df0d0e355d77" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:07:57.034652 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Instance network_info: |[{"id": "45acff40-a26b-4b33-a063-9d37ec161b50", "address": "fa:16:3e:77:42:d7", "network": {"id": "c84eb370-cb9f-4ac9-8ec5-c18123b64612", "bridge": "br-int", "label": "tempest-ServerMetadataTestJSON-2005128381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d71dbd6f9d5b41cbb2491c5735419ee1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45acff40-a2", "ovs_interfaceid": "45acff40-a26b-4b33-a063-9d37ec161b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:07:57.036690 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Start _get_guest_xml network_info=[{"id": "45acff40-a26b-4b33-a063-9d37ec161b50", "address": "fa:16:3e:77:42:d7", "network": {"id": "c84eb370-cb9f-4ac9-8ec5-c18123b64612", "bridge": "br-int", "label": "tempest-ServerMetadataTestJSON-2005128381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d71dbd6f9d5b41cbb2491c5735419ee1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45acff40-a2", "ovs_interfaceid": "45acff40-a26b-4b33-a063-9d37ec161b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:07:57.041347 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:07:57.042684 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerMetadataTestJSON-server-908361933', uuid='b45e5bd0-6b91-4999-bfb3-df0d0e355d77'), owner=OwnerMeta(userid='87970c72a3184e05adfff584170d6dd5', username='tempest-ServerMetadataTestJSON-883527565-project-member', projectid='d71dbd6f9d5b41cbb2491c5735419ee1', projectname='tempest-ServerMetadataTestJSON-883527565'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "45acff40-a26b-4b33-a063-9d37ec161b50", "address": "fa:16:3e:77:42:d7", "network": {"id": "c84eb370-cb9f-4ac9-8ec5-c18123b64612", "bridge": "br-int", "label": "tempest-ServerMetadataTestJSON-2005128381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d71dbd6f9d5b41cbb2491c5735419ee1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45acff40-a2", "ovs_interfaceid": "45acff40-a26b-4b33-a063-9d37ec161b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472477.0423362) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:07:57.044586 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:07:57.045016 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:07:57.046172 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:07:57.046659 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:07:57.047698 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:07:57.049792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:07:57.049792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:07:57.049792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:07:57.049792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:07:57.049792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:07:57.049792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:07:57.049792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:07:57.049792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:07:57.049792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:07:57.049792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:07:57.049792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:07:57.052956 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerMetadataTestJSON-server-908361933',display_name='tempest-ServerMetadataTestJSON-server-908361933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-servermetadatatestjson-server-908361933',id=75,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d71dbd6f9d5b41cbb2491c5735419ee1',ramdisk_id='',reservation_id='r-7z57z0w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerMetadataTestJSON-883527565',owner_user_name='tempest-ServerMetadataTestJSON-883527565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:07:54Z,user_data=None,user_id='87970c72a3184e05adfff584170d6dd5',uuid=b45e5bd0-6b91-4999-bfb3-df0d0e355d77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45acff40-a26b-4b33-a063-9d37ec161b50", "address": "fa:16:3e:77:42:d7", "network": {"id": "c84eb370-cb9f-4ac9-8ec5-c18123b64612", "bridge": "br-int", "label": "tempest-ServerMetadataTestJSON-2005128381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d71dbd6f9d5b41cbb2491c5735419ee1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45acff40-a2", "ovs_interfaceid": "45acff40-a26b-4b33-a063-9d37ec161b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:07:57.053132 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Converting VIF {"id": "45acff40-a26b-4b33-a063-9d37ec161b50", "address": "fa:16:3e:77:42:d7", "network": {"id": "c84eb370-cb9f-4ac9-8ec5-c18123b64612", "bridge": "br-int", "label": "tempest-ServerMetadataTestJSON-2005128381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d71dbd6f9d5b41cbb2491c5735419ee1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45acff40-a2", "ovs_interfaceid": "45acff40-a26b-4b33-a063-9d37ec161b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:07:57.053824 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:42:d7,bridge_name='br-int',has_traffic_filtering=True,id=45acff40-a26b-4b33-a063-9d37ec161b50,network=Network(c84eb370-cb9f-4ac9-8ec5-c18123b64612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45acff40-a2') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:07:57.054359 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Lazy-loading 'pci_devices' on Instance uuid b45e5bd0-6b91-4999-bfb3-df0d0e355d77 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:07:57.096800 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:57.268891 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:07:57.270202 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:57.281684 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:57.281930 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e79b38-1a0c-4b92-b8f5-264e903ee255]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.name = iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.tpgt = -1 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.startup = automatic Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.leading_login = No Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.iscsi_ifacename = default Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.net_ifacename = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.ipaddress = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.prefix_len = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.hwaddress = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.transport_name = tcp Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.initiatorname = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.state = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.vlan_id = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.vlan_priority = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.vlan_state = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.iface_num = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.mtu = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.port = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.bootproto = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.subnet_mask = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.gateway = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id_state = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.dhcp_dns = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.dhcp_learn_iqn = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.dhcp_req_vendor_id_state = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id_state = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.dhcp_slp_da = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.fragmentation = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.gratuitous_arp = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.incoming_forwarding = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.tos_state = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.tos = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.ttl = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.delayed_ack = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.tcp_nagle = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf_state = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.tcp_timer_scale = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.tcp_timestamp = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.redirect = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.def_task_mgmt_timeout = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.header_digest = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.data_digest = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.immediate_data = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.initial_r2t = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.data_seq_inorder = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.data_pdu_inorder = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.erl = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.max_receive_data_len = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.first_burst_len = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.max_outstanding_r2t = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.max_burst_len = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.chap_auth = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.bidi_chap = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.strict_login_compliance = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.discovery_auth = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: iface.discovery_logout = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.discovery_address = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.discovery_port = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.discovery_type = fw Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.initial_cmdsn = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.initial_login_retry_max = 8 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.xmit_thread_priority = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.cmds_max = 128 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.queue_depth = 32 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.nr_sessions = 1 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.auth.authmethod = None Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.auth.username = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.auth.password = *** Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.auth.username_in = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.auth.password_in = Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.timeo.replacement_timeout = 120 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FastAbort = Yes Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.InitialR2T = No Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ImmediateData = Yes Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxConnections = 1 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ERL = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.scan = auto Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.reopen_max = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.session.conn_reopen_log_freq = 1 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.conn[0].address = 38.102.83.18 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.conn[0].port = 3260 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.conn[0].startup = manual Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.window_size = 524288 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.DataDigest = None Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.IFMarker = No Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.OFMarker = No Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: # END RECORD Jan 26 19:07:57.283195 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:07:57.285903 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:57.291830 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:57.292024 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[68af7d21-6511-47a1-b849-6c9818c3c406]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:57.292425 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:07:57.293249 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:57.302327 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:57.302587 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8944fb-b0a6-4b66-aa7d-2a62fe82051f]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:57.303172 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:07:57.305374 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v Scs6TyYAxWX4riLALM2P {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:57.317306 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v Scs6TyYAxWX4riLALM2P" returned: 0 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:57.317559 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79cdc1c-9d60-4ef8-9370-399ca75ae13c]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:57.318100 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Scs6TyYAxWX4riLALM2P'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:07:57.319499 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:57.331246 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:57.331496 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[70177743-019e-45de-830c-963112d93db1]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:57.332267 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:07:57.333857 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:57.348413 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.014s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:57.348588 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f0157b-b1ec-46dd-9990-a3a816b864dd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:57.349034 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jan 26 19:07:57.349034 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:07:57.349228 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jan 26 19:07:57.349228 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:07:57.349412 np0005596550.novalocal nova-compute[189076]: WARNING os_brick.initiator.connectors.iscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jan 26 19:07:57.349412 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.350440 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260 --login {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:57.371668 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260 --login" returned: 0 in 0.021s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:57.371972 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b247c0d-495f-4e31-a9d3-0c30eac3f9ec]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:57.372368 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05, portal: 38.102.83.18,3260] successful. Jan 26 19:07:57.372368 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:07:57.373547 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:57.385573 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:57.385756 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47539fa-af1b-480e-9bf3-ab24c7f409c7]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:57.386216 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:07:57.387167 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:57.401333 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.014s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:57.401523 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[760235c8-3a9a-4419-923d-5bdb4f2ba1a2]: (4, ('tcp: [12] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:57.401950 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 (non-flash) Jan 26 19:07:57.401950 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:07:57.402138 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsi session list stdout=tcp: [12] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 (non-flash) Jan 26 19:07:57.402138 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:07:57.402513 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:07:57.402715 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Connected to 38.102.83.18:3260 {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:07:57.403283 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] HCTL ('2', '-', '-', 0) found on session 12 with lun 0 {{(pid=189076) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:07:57.403469 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Scanning host 2 c: -, t: -, l: 0) {{(pid=189076) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:07:57.404484 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host2/scan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:57.431404 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host2/scan" returned: 0 in 0.024s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:57.431404 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bfd667-cab2-45fd-884b-6c582bd17d1a]: (4, ('- - 0', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:07:57.431404 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Searching for a device in session 12 and hctl ['2', '*', '*', 0] yield: None {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] End _get_guest_xml xml= Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: b45e5bd0-6b91-4999-bfb3-df0d0e355d77 Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: instance-0000004b Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: tempest-ServerMetadataTestJSON-server-908361933 Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:07:57 Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: tempest-ServerMetadataTestJSON-883527565-project-member Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: tempest-ServerMetadataTestJSON-883527565 Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: b45e5bd0-6b91-4999-bfb3-df0d0e355d77 Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: b45e5bd0-6b91-4999-bfb3-df0d0e355d77 Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:57.560495 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:07:57.562562 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Preparing to wait for external event network-vif-plugged-45acff40-a26b-4b33-a063-9d37ec161b50 {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:07:57.562562 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Acquiring lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:07:57.562562 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:07:57.562562 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:07:57.563677 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerMetadataTestJSON-server-908361933',display_name='tempest-ServerMetadataTestJSON-server-908361933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-servermetadatatestjson-server-908361933',id=75,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d71dbd6f9d5b41cbb2491c5735419ee1',ramdisk_id='',reservation_id='r-7z57z0w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerMetadataTestJSON-883527565',owner_user_name='tempest-ServerMetadataTestJSON-883527565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:07:54Z,user_data=None,user_id='87970c72a3184e05adfff584170d6dd5',uuid=b45e5bd0-6b91-4999-bfb3-df0d0e355d77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45acff40-a26b-4b33-a063-9d37ec161b50", "address": "fa:16:3e:77:42:d7", "network": {"id": "c84eb370-cb9f-4ac9-8ec5-c18123b64612", "bridge": "br-int", "label": "tempest-ServerMetadataTestJSON-2005128381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d71dbd6f9d5b41cbb2491c5735419ee1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45acff40-a2", "ovs_interfaceid": "45acff40-a26b-4b33-a063-9d37ec161b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:07:57.563927 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Converting VIF {"id": "45acff40-a26b-4b33-a063-9d37ec161b50", "address": "fa:16:3e:77:42:d7", "network": {"id": "c84eb370-cb9f-4ac9-8ec5-c18123b64612", "bridge": "br-int", "label": "tempest-ServerMetadataTestJSON-2005128381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d71dbd6f9d5b41cbb2491c5735419ee1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45acff40-a2", "ovs_interfaceid": "45acff40-a26b-4b33-a063-9d37ec161b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:07:57.564564 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:42:d7,bridge_name='br-int',has_traffic_filtering=True,id=45acff40-a26b-4b33-a063-9d37ec161b50,network=Network(c84eb370-cb9f-4ac9-8ec5-c18123b64612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45acff40-a2') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:07:57.564899 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:42:d7,bridge_name='br-int',has_traffic_filtering=True,id=45acff40-a26b-4b33-a063-9d37ec161b50,network=Network(c84eb370-cb9f-4ac9-8ec5-c18123b64612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45acff40-a2') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:07:57.565397 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:57.566346 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:57.566657 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:07:57.567498 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:57.567754 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7af6c6f8-76c0-5cfd-8f78-bc23cd70bd57', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:57.571434 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:57.575183 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:57.579084 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:57.579337 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45acff40-a2, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:57.579745 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45acff40-a2, col_values=(('qos', UUID('8491c93f-e688-48ac-9ca6-a4ab847ba4ed')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:57.579989 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45acff40-a2, col_values=(('external_ids', {'iface-id': '45acff40-a26b-4b33-a063-9d37ec161b50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:42:d7', 'vm-uuid': 'b45e5bd0-6b91-4999-bfb3-df0d0e355d77'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:07:57.582626 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:57.584103 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:07:57.591652 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:57.592506 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:42:d7,bridge_name='br-int',has_traffic_filtering=True,id=45acff40-a26b-4b33-a063-9d37ec161b50,network=Network(c84eb370-cb9f-4ac9-8ec5-c18123b64612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45acff40-a2') Jan 26 19:07:58.432820 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Searching for a device in session 12 and hctl ['2', '*', '*', 0] yield: sda {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:07:58.433382 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Connected to sda using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05', 'target_lun': 0, 'volume_id': '45ac36d4-0d45-4d42-8723-1353aae47e05', 'auth_method': 'CHAP', 'auth_username': 'Scs6TyYAxWX4riLALM2P', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True} {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:07:58.434103 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.239s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:07:58.434337 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] <== connect_volume: return (2239ms) {'type': 'block', 'scsi_wwn': '360014055ecac6094e6842b582386ce6c', 'path': '/dev/sda'} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:07:58.434559 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '360014055ecac6094e6842b582386ce6c', 'path': '/dev/sda'} {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jan 26 19:07:58.438961 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lazy-loading 'flavor' on Instance uuid b7041c4d-2e69-4988-bd5d-a9e302629220 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:07:58.945699 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] attach device xml: Jan 26 19:07:58.945699 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:58.945699 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:58.945699 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:58.945699 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:58.945699 np0005596550.novalocal nova-compute[189076]: 45ac36d4-0d45-4d42-8723-1353aae47e05 Jan 26 19:07:58.945699 np0005596550.novalocal nova-compute[189076]: Jan 26 19:07:58.945699 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:330}} Jan 26 19:07:59.155497 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:07:59.155567 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:07:59.155815 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] No VIF found with MAC fa:16:3e:77:42:d7, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:07:59.156303 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Using config drive Jan 26 19:07:59.662549 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:07:59.750748 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Creating config drive at /opt/stack/data/nova/instances/b45e5bd0-6b91-4999-bfb3-df0d0e355d77/disk.config Jan 26 19:07:59.759089 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/b45e5bd0-6b91-4999-bfb3-df0d0e355d77/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp46x5eg8j {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:07:59.884618 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/b45e5bd0-6b91-4999-bfb3-df0d0e355d77/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp46x5eg8j" returned: 0 in 0.125s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:07:59.973364 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:59.986824 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:07:59.994259 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:00.248336 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:08:00.248499 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] VM Started (Lifecycle Event) Jan 26 19:08:00.264738 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4fda6b4c-f5d2-4ea9-8fb7-1309c0c38a5e req-013d8c2a-5155-420d-b78e-e8f969abbbb7 service nova] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Received event network-vif-plugged-45acff40-a26b-4b33-a063-9d37ec161b50 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:08:00.265191 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4fda6b4c-f5d2-4ea9-8fb7-1309c0c38a5e req-013d8c2a-5155-420d-b78e-e8f969abbbb7 service nova] Acquiring lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:00.265319 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4fda6b4c-f5d2-4ea9-8fb7-1309c0c38a5e req-013d8c2a-5155-420d-b78e-e8f969abbbb7 service nova] Lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:00.265550 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4fda6b4c-f5d2-4ea9-8fb7-1309c0c38a5e req-013d8c2a-5155-420d-b78e-e8f969abbbb7 service nova] Lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:00.265730 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4fda6b4c-f5d2-4ea9-8fb7-1309c0c38a5e req-013d8c2a-5155-420d-b78e-e8f969abbbb7 service nova] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Processing event network-vif-plugged-45acff40-a26b-4b33-a063-9d37ec161b50 {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:08:00.269844 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:08:00.282962 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:08:00.288809 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Instance spawned successfully. Jan 26 19:08:00.289143 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:08:00.400494 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:00.408625 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:00.411984 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:00.417981 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:00.546097 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:08:00.546249 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] No BDM found with device name vdb, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:08:00.547415 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:08:00.548905 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] No VIF found with MAC fa:16:3e:46:b2:64, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:08:00.752815 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:00.755868 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:08:00.801621 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:00.801923 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:00.802409 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:00.802911 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:00.803545 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:00.804012 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:01.260146 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:08:01.260375 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:08:01.260556 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] VM Paused (Lifecycle Event) Jan 26 19:08:01.311069 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Took 6.01 seconds to spawn the instance on the hypervisor. Jan 26 19:08:01.311243 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:01.764658 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:01.767909 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:08:01.768156 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] VM Resumed (Lifecycle Event) Jan 26 19:08:01.824412 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Took 11.37 seconds to build instance. Jan 26 19:08:02.103904 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:02.134358 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-aefb50bf-2097-43c2-9852-07c1e144a618 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "b7041c4d-2e69-4988-bd5d-a9e302629220" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 10.126s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:02.276240 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:02.287570 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:08:02.329711 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ba548236-6eeb-4854-bd24-6b31ee517b58 req-75ed4443-3e25-46a2-afd6-607503e03831 service nova] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Received event network-vif-plugged-45acff40-a26b-4b33-a063-9d37ec161b50 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:08:02.329996 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ba548236-6eeb-4854-bd24-6b31ee517b58 req-75ed4443-3e25-46a2-afd6-607503e03831 service nova] Acquiring lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:02.330215 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ba548236-6eeb-4854-bd24-6b31ee517b58 req-75ed4443-3e25-46a2-afd6-607503e03831 service nova] Lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:02.330418 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ba548236-6eeb-4854-bd24-6b31ee517b58 req-75ed4443-3e25-46a2-afd6-607503e03831 service nova] Lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:02.330862 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ba548236-6eeb-4854-bd24-6b31ee517b58 req-75ed4443-3e25-46a2-afd6-607503e03831 service nova] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] No waiting events found dispatching network-vif-plugged-45acff40-a26b-4b33-a063-9d37ec161b50 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:08:02.331057 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-ba548236-6eeb-4854-bd24-6b31ee517b58 req-75ed4443-3e25-46a2-afd6-607503e03831 service nova] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Received unexpected event network-vif-plugged-45acff40-a26b-4b33-a063-9d37ec161b50 for instance with vm_state active and task_state None. Jan 26 19:08:02.331742 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bedea63f-54b3-4fd7-ba31-308cb4e99747 tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 12.885s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:02.581967 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:04.288175 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Acquiring lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:04.288616 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:04.288962 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Acquiring lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:04.289863 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:04.290134 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:04.293689 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Terminating instance Jan 26 19:08:04.804731 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:08:04.855617 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:04.891624 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:04.904120 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:05.061267 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5c8dde17-4bc6-46e5-a828-8df8a849f10f req-45bbe396-777d-46fa-9974-fbd775653373 service nova] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Received event network-vif-unplugged-45acff40-a26b-4b33-a063-9d37ec161b50 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:08:05.062706 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5c8dde17-4bc6-46e5-a828-8df8a849f10f req-45bbe396-777d-46fa-9974-fbd775653373 service nova] Acquiring lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:05.062706 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5c8dde17-4bc6-46e5-a828-8df8a849f10f req-45bbe396-777d-46fa-9974-fbd775653373 service nova] Lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:05.062706 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5c8dde17-4bc6-46e5-a828-8df8a849f10f req-45bbe396-777d-46fa-9974-fbd775653373 service nova] Lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:05.062706 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5c8dde17-4bc6-46e5-a828-8df8a849f10f req-45bbe396-777d-46fa-9974-fbd775653373 service nova] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] No waiting events found dispatching network-vif-unplugged-45acff40-a26b-4b33-a063-9d37ec161b50 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:08:05.062706 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5c8dde17-4bc6-46e5-a828-8df8a849f10f req-45bbe396-777d-46fa-9974-fbd775653373 service nova] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Received event network-vif-unplugged-45acff40-a26b-4b33-a063-9d37ec161b50 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:08:05.086571 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Instance destroyed successfully. Jan 26 19:08:05.086848 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Lazy-loading 'resources' on Instance uuid b45e5bd0-6b91-4999-bfb3-df0d0e355d77 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:08:05.591886 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerMetadataTestJSON-server-908361933',display_name='tempest-ServerMetadataTestJSON-server-908361933',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-servermetadatatestjson-server-908361933',id=75,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:08:01Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={key1='alt1',key2='value2',key3='value3'},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='d71dbd6f9d5b41cbb2491c5735419ee1',ramdisk_id='',reservation_id='r-7z57z0w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerMetadataTestJSON-883527565',owner_user_name='tempest-ServerMetadataTestJSON-883527565-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:08:03Z,user_data=None,user_id='87970c72a3184e05adfff584170d6dd5',uuid=b45e5bd0-6b91-4999-bfb3-df0d0e355d77,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45acff40-a26b-4b33-a063-9d37ec161b50", "address": "fa:16:3e:77:42:d7", "network": {"id": "c84eb370-cb9f-4ac9-8ec5-c18123b64612", "bridge": "br-int", "label": "tempest-ServerMetadataTestJSON-2005128381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d71dbd6f9d5b41cbb2491c5735419ee1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45acff40-a2", "ovs_interfaceid": "45acff40-a26b-4b33-a063-9d37ec161b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:08:05.591886 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Converting VIF {"id": "45acff40-a26b-4b33-a063-9d37ec161b50", "address": "fa:16:3e:77:42:d7", "network": {"id": "c84eb370-cb9f-4ac9-8ec5-c18123b64612", "bridge": "br-int", "label": "tempest-ServerMetadataTestJSON-2005128381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d71dbd6f9d5b41cbb2491c5735419ee1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45acff40-a2", "ovs_interfaceid": "45acff40-a26b-4b33-a063-9d37ec161b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:08:05.595976 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:42:d7,bridge_name='br-int',has_traffic_filtering=True,id=45acff40-a26b-4b33-a063-9d37ec161b50,network=Network(c84eb370-cb9f-4ac9-8ec5-c18123b64612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45acff40-a2') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:08:05.595976 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:42:d7,bridge_name='br-int',has_traffic_filtering=True,id=45acff40-a26b-4b33-a063-9d37ec161b50,network=Network(c84eb370-cb9f-4ac9-8ec5-c18123b64612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45acff40-a2') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:08:05.597173 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:05.597875 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45acff40-a2, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:08:05.599909 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:05.603486 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:05.605391 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:05.606027 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8491c93f-e688-48ac-9ca6-a4ab847ba4ed) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:08:05.607077 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:05.609440 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:08:05.610409 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:05.612922 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:42:d7,bridge_name='br-int',has_traffic_filtering=True,id=45acff40-a26b-4b33-a063-9d37ec161b50,network=Network(c84eb370-cb9f-4ac9-8ec5-c18123b64612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45acff40-a2') Jan 26 19:08:05.613524 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Deleting instance files /opt/stack/data/nova/instances/b45e5bd0-6b91-4999-bfb3-df0d0e355d77_del Jan 26 19:08:05.614532 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Deletion of /opt/stack/data/nova/instances/b45e5bd0-6b91-4999-bfb3-df0d0e355d77_del complete Jan 26 19:08:06.123890 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Took 1.32 seconds to destroy the instance on the hypervisor. Jan 26 19:08:06.124111 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:08:06.124451 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:08:06.124615 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:08:06.124980 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:06.190793 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:07.050016 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:08:07.107754 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:07.115958 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-82acb8dc-5520-4229-8243-ad854f1dc640 req-adfe5fac-2239-4585-97b1-34ec8743bbc4 service nova] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Received event network-vif-unplugged-45acff40-a26b-4b33-a063-9d37ec161b50 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:08:07.115958 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-82acb8dc-5520-4229-8243-ad854f1dc640 req-adfe5fac-2239-4585-97b1-34ec8743bbc4 service nova] Acquiring lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:07.115958 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-82acb8dc-5520-4229-8243-ad854f1dc640 req-adfe5fac-2239-4585-97b1-34ec8743bbc4 service nova] Lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:07.116294 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-82acb8dc-5520-4229-8243-ad854f1dc640 req-adfe5fac-2239-4585-97b1-34ec8743bbc4 service nova] Lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:07.118069 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-82acb8dc-5520-4229-8243-ad854f1dc640 req-adfe5fac-2239-4585-97b1-34ec8743bbc4 service nova] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] No waiting events found dispatching network-vif-unplugged-45acff40-a26b-4b33-a063-9d37ec161b50 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:08:07.119088 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-82acb8dc-5520-4229-8243-ad854f1dc640 req-adfe5fac-2239-4585-97b1-34ec8743bbc4 service nova] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Received event network-vif-unplugged-45acff40-a26b-4b33-a063-9d37ec161b50 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:08:07.119088 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-82acb8dc-5520-4229-8243-ad854f1dc640 req-adfe5fac-2239-4585-97b1-34ec8743bbc4 service nova] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Received event network-vif-deleted-45acff40-a26b-4b33-a063-9d37ec161b50 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:08:07.582841 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Took 1.46 seconds to deallocate network for instance. Jan 26 19:08:08.099792 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:08.100165 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:08.325523 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:08:08.831529 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:08:09.336716 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.237s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:09.405218 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Deleted allocations for instance b45e5bd0-6b91-4999-bfb3-df0d0e355d77 Jan 26 19:08:10.427007 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b4d1babf-0599-4e28-998d-954d07a07e1d tempest-ServerMetadataTestJSON-883527565 tempest-ServerMetadataTestJSON-883527565-project-member] Lock "b45e5bd0-6b91-4999-bfb3-df0d0e355d77" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.138s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:10.607661 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:10.854815 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "b7041c4d-2e69-4988-bd5d-a9e302629220" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:10.855087 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "b7041c4d-2e69-4988-bd5d-a9e302629220" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:10.950111 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "b7041c4d-2e69-4988-bd5d-a9e302629220" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:11.360630 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Detaching volume 45ac36d4-0d45-4d42-8723-1353aae47e05 Jan 26 19:08:11.416939 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.block_device [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Attempting to driver detach volume 45ac36d4-0d45-4d42-8723-1353aae47e05 from mountpoint /dev/vdb Jan 26 19:08:11.425252 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Found disk vdb by alias ua-45ac36d4-0d45-4d42-8723-1353aae47e05 {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:08:11.441955 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Found disk vdb by alias ua-45ac36d4-0d45-4d42-8723-1353aae47e05 {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:08:11.442358 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Attempting to detach device vdb from instance b7041c4d-2e69-4988-bd5d-a9e302629220 from the persistent domain config. {{(pid=189076) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2599}} Jan 26 19:08:11.442512 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] detach device xml: Jan 26 19:08:11.442512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:11.442512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:11.442512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:11.442512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:11.442512 np0005596550.novalocal nova-compute[189076]: 45ac36d4-0d45-4d42-8723-1353aae47e05 Jan 26 19:08:11.442512 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:08:11.442512 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:11.442512 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:08:11.449352 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Found disk vdb by alias ua-45ac36d4-0d45-4d42-8723-1353aae47e05 {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:08:11.449523 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Failed to detach device vdb from instance b7041c4d-2e69-4988-bd5d-a9e302629220 from the persistent domain config. Libvirt did not report any error but the device is still in the config. Jan 26 19:08:11.449722 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] (1/8): Attempting to detach device vdb with device alias ua-45ac36d4-0d45-4d42-8723-1353aae47e05 from instance b7041c4d-2e69-4988-bd5d-a9e302629220 from the live domain config. {{(pid=189076) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2633}} Jan 26 19:08:11.450096 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] detach device xml: Jan 26 19:08:11.450096 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:11.450096 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:11.450096 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:11.450096 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:11.450096 np0005596550.novalocal nova-compute[189076]: 45ac36d4-0d45-4d42-8723-1353aae47e05 Jan 26 19:08:11.450096 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:08:11.450096 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:11.450096 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:08:11.593699 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Received event ua-45ac36d4-0d45-4d42-8723-1353aae47e05> from libvirt while the driver is waiting for it; dispatched. {{(pid=189076) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2486}} Jan 26 19:08:11.595049 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-45ac36d4-0d45-4d42-8723-1353aae47e05 for instance b7041c4d-2e69-4988-bd5d-a9e302629220 {{(pid=189076) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2713}} Jan 26 19:08:11.602807 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Successfully detached device vdb from instance b7041c4d-2e69-4988-bd5d-a9e302629220 from the live domain config. Jan 26 19:08:11.604478 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] calling os-brick to detach iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jan 26 19:08:11.605307 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05', 'target_lun': 0, 'volume_id': '45ac36d4-0d45-4d42-8723-1353aae47e05', 'auth_method': 'CHAP', 'auth_username': 'Scs6TyYAxWX4riLALM2P', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sda'}, None), 'kwargs': False}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:08:11.605506 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:08:11.605962 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:08:11.607312 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:11.620145 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:11.620366 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a2f3ff-0bf9-4ca3-977a-28042bc0ebb7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:08:11.620781 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:08:11.620781 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:08:11.620781 np0005596550.novalocal nova-compute[189076]: iSNS: Jan 26 19:08:11.620781 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:08:11.620781 np0005596550.novalocal nova-compute[189076]: STATIC: Jan 26 19:08:11.620781 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 Jan 26 19:08:11.620781 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:08:11.620781 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:08:11.620781 np0005596550.novalocal nova-compute[189076]: FIRMWARE: Jan 26 19:08:11.620781 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:08:11.620781 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:08:11.621086 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:08:11.621086 np0005596550.novalocal nova-compute[189076]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:08:11.621086 np0005596550.novalocal nova-compute[189076]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=189076) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:08:11.621364 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05', 0)] {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:08:11.622129 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:11.634496 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:11.634496 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e6e354-e6a0-4a3a-8f04-96952483842d]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:08:11.635126 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:11.646351 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:11.646602 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde58045-f7ce-45fe-89ab-ab6ece6b3172]: (4, ('tcp: [12] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:08:11.650191 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 (non-flash) Jan 26 19:08:11.650191 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:08:11.650191 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsi session list stdout=tcp: [12] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 (non-flash) Jan 26 19:08:11.650191 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:08:11.650191 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Resulting device map defaultdict(. at 0x7fd72c3614e0>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05'): ({'sda'}, set())}) {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:08:11.650191 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Removing single pathed devices sda {{(pid=189076) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:08:11.652153 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:11.659844 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:08:11.661236 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[919e4984-55cc-4b79-95df-710658fcf607]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:08:11.661236 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:08:11.661236 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:08:11.661236 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:08:11.661236 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:08:11.661236 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:08:11.661236 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:08:11.661236 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:08:11.661236 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:08:11.661236 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:08:11.661236 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:08:11.661236 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:08:11.661236 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:08:11.661236 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:08:11.661236 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:08:11.661236 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:08:11.661236 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:08:11.661236 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:08:11.661236 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:08:11.661236 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:08:11.661236 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:08:11.661236 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:08:11.662294 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[919e4984-55cc-4b79-95df-710658fcf607]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:08:11.662858 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Flushing IO for device /dev/sda {{(pid=189076) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:08:11.663655 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sda {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:11.670968 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sda" returned: 0 in 0.005s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:11.670968 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e4e99f-2e12-4d5a-b9b2-76a1e6b2d567]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:08:11.670968 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Remove SCSI device /dev/sda with /sys/block/sda/device/delete {{(pid=189076) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:08:11.671740 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sda/device/delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:11.718455 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sda/device/delete" returned: 0 in 0.044s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:11.718571 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ea9c1a-92b9-440e-bb64-3f6286082f56]: (4, ('1', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:08:11.719047 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Checking to see if SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:08:11.719198 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:08:11.719457 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05')] {{(pid=189076) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:08:11.720435 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:11.730126 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:11.730251 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b5185a-7ba7-4309-9804-a336074cfb03]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:08:11.730629 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:08:11.731557 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260 --logout {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:11.764906 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260 --logout" returned: 0 in 0.032s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:11.764906 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[2761d583-eb78-49f6-874e-c287843f8b79]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05, portal: 38.102.83.18,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:08:11.764906 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05, portal: 38.102.83.18,3260] Jan 26 19:08:11.764906 np0005596550.novalocal nova-compute[189076]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05, portal: 38.102.83.18,3260] successful. Jan 26 19:08:11.764906 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:08:11.765459 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260 --op delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:11.781685 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05 -p 38.102.83.18:3260 --op delete" returned: 0 in 0.016s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:11.781996 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd130847-3b0d-4e57-ab55-f95f3f978ff3]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:08:11.782214 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:08:11.782485 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.177s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:08:11.782626 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] <== disconnect_volume: return (176ms) None {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:08:11.782797 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Disconnected iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jan 26 19:08:12.109847 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:12.721805 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:14.895858 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:08:15.407055 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:15.407325 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:15.407485 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:15.407745 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:08:15.610257 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:15.830694 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lazy-loading 'flavor' on Instance uuid b7041c4d-2e69-4988-bd5d-a9e302629220 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:08:16.453515 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:16.521809 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk --force-share --output=json" returned: 0 in 0.068s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:16.522199 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:16.602200 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:16.609233 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7041c4d-2e69-4988-bd5d-a9e302629220/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:16.691042 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7041c4d-2e69-4988-bd5d-a9e302629220/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:16.691636 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7041c4d-2e69-4988-bd5d-a9e302629220/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:16.805208 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7041c4d-2e69-4988-bd5d-a9e302629220/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:16.811063 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:16.870481 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8e504de3-2d39-4b12-84ee-ea8a626d5c21 tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "b7041c4d-2e69-4988-bd5d-a9e302629220" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 6.015s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:16.871998 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "b7041c4d-2e69-4988-bd5d-a9e302629220" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 5.923s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:16.872263 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "b7041c4d-2e69-4988-bd5d-a9e302629220-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:16.872472 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "b7041c4d-2e69-4988-bd5d-a9e302629220-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:16.872614 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "b7041c4d-2e69-4988-bd5d-a9e302629220-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:16.879005 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Terminating instance Jan 26 19:08:16.890191 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:16.890878 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:17.019277 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:17.110950 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:17.207589 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:17.229242 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:08:17.230394 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:17.247218 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.017s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:17.247577 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=7051MB free_disk=373.35164642333984GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:08:17.247732 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:17.248038 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:17.384509 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:08:17.411944 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:17.448393 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:17.460096 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:17.663401 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Instance destroyed successfully. Jan 26 19:08:17.663401 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lazy-loading 'resources' on Instance uuid b7041c4d-2e69-4988-bd5d-a9e302629220 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:08:17.688225 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:18.166529 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-118328640',display_name='tempest-VolumesSnapshotTestJSON-instance-118328640',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-volumessnapshottestjson-instance-118328640',id=73,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKt7+m1jFIoM2D12yrOKYafKjvfBS/DXB4r/HrHsnnMQ2LrFxR25amGpOF5S+AogjnRlNTno5u6QDqbOKgUvgJKYNKVepEuxR2qznLofXZ+/qoMbntpqVvclWMBSl1ekxg==',key_name='tempest-keypair-8186708',keypairs=,launch_index=0,launched_at=2026-01-27T00:07:10Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='c55032abafa74d4facac03929da4a366',ramdisk_id='',reservation_id='r-g6faoujj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-666453103',owner_user_name='tempest-VolumesSnapshotTestJSON-666453103-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:07:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9bb266354284323ae54b4c3317c26e5',uuid=b7041c4d-2e69-4988-bd5d-a9e302629220,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ffd86c4-b487-449b-9277-55f5ae19d100", "address": "fa:16:3e:46:b2:64", "network": {"id": "e3c16b95-f7e4-4902-8796-2e826827292b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093833914-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c55032abafa74d4facac03929da4a366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ffd86c4-b4", "ovs_interfaceid": "3ffd86c4-b487-449b-9277-55f5ae19d100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:08:18.166756 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Converting VIF {"id": "3ffd86c4-b487-449b-9277-55f5ae19d100", "address": "fa:16:3e:46:b2:64", "network": {"id": "e3c16b95-f7e4-4902-8796-2e826827292b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093833914-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c55032abafa74d4facac03929da4a366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ffd86c4-b4", "ovs_interfaceid": "3ffd86c4-b487-449b-9277-55f5ae19d100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:08:18.167598 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:b2:64,bridge_name='br-int',has_traffic_filtering=True,id=3ffd86c4-b487-449b-9277-55f5ae19d100,network=Network(e3c16b95-f7e4-4902-8796-2e826827292b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ffd86c4-b4') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:08:18.167930 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:b2:64,bridge_name='br-int',has_traffic_filtering=True,id=3ffd86c4-b487-449b-9277-55f5ae19d100,network=Network(e3c16b95-f7e4-4902-8796-2e826827292b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ffd86c4-b4') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:08:18.169194 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:18.169471 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ffd86c4-b4, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:08:18.170909 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:18.173424 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:18.174167 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:18.174393 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3278b0bd-0597-420e-ab74-bef48d93cfc8) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:08:18.174945 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:18.176708 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:08:18.178184 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:18.180620 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:b2:64,bridge_name='br-int',has_traffic_filtering=True,id=3ffd86c4-b487-449b-9277-55f5ae19d100,network=Network(e3c16b95-f7e4-4902-8796-2e826827292b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ffd86c4-b4') Jan 26 19:08:18.182587 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] calling os-brick to detach iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jan 26 19:08:18.183261 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-45ac36d4-0d45-4d42-8723-1353aae47e05', 'target_lun': 0, 'volume_id': '45ac36d4-0d45-4d42-8723-1353aae47e05', 'auth_method': 'CHAP', 'auth_username': 'Scs6TyYAxWX4riLALM2P', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sda'}, None), 'kwargs': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:08:18.183449 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:08:18.183963 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:08:18.184981 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:18.198589 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:18.198751 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[a618e037-e6ed-4e92-acf8-aa2042f7977d]: Unexpected error while running command. Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: Command: iscsiadm -m discoverydb -o show -P 1 Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: Exit code: 21 Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n' Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: Stderr: '' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 388, in execute Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: raise ProcessExecutionError(exit_code=_returncode, Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command. Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: Command: iscsiadm -m discoverydb -o show -P 1 Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: Exit code: 21 Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n' Jan 26 19:08:18.199821 np0005596550.novalocal nova-compute[189076]: Stderr: '' Jan 26 19:08:18.200496 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a618e037-e6ed-4e92-acf8-aa2042f7977d]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 388, in execute\n raise ProcessExecutionError(exit_code=_returncode,\noslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.\nCommand: iscsiadm -m discoverydb -o show -P 1\nExit code: 21\nStdout: \'SENDTARGETS:\\nNo targets found.\\niSNS:\\nNo targets found.\\nSTATIC:\\nNo targets found.\\nFIRMWARE:\\nNo targets found.\\n\'\nStderr: \'\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command. Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: Command: iscsiadm -m discoverydb -o show -P 1 Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: Exit code: 21 Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n' Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: Stderr: '' Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last): Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py", line 227, in _get_ips_iqns_luns Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ips_iqns_luns = method(connection_properties) Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py", line 386, in _get_discoverydb_portals Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi out = self._run_iscsiadm_bare(['-m', 'discoverydb', Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py", line 1218, in _run_iscsiadm_bare Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi (out, err) = self._execute('iscsiadm', Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/os_brick/executor.py", line 55, in _execute Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi result = self.__execute(*args, **kwargs) Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 173, in execute Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi return execute_root(*cmd, **kwargs) Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 267, in _wrap Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi return self.channel.remote_call(name, args, kwargs, Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 230, in remote_call Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi raise exc_type(*result[2]) Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command. Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1 Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21 Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n' Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Stderr: '' Jan 26 19:08:18.201485 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Jan 26 19:08:18.202029 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Skipping cleanup Unable to find target portal 38.102.83.18:3260. {{(pid=189076) _cleanup_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:959}} Jan 26 19:08:18.202609 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.018s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:08:18.202814 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] <== disconnect_volume: return (19ms) None {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:08:18.202947 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Disconnected iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jan 26 19:08:18.203258 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Deleting instance files /opt/stack/data/nova/instances/b7041c4d-2e69-4988-bd5d-a9e302629220_del Jan 26 19:08:18.203639 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Deletion of /opt/stack/data/nova/instances/b7041c4d-2e69-4988-bd5d-a9e302629220_del complete Jan 26 19:08:18.334959 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance d0ddb554-76ed-49a6-a02b-042680eb310d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:08:18.335178 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance b7041c4d-2e69-4988-bd5d-a9e302629220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:08:18.335344 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:08:18.336018 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 3 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:08:18.336162 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=1088MB phys_disk=399GB used_disk=3GB total_vcpus=8 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:08:17 up 36 min, 13 users, load average: 5.04, 5.06, 3.90\n', 'num_instances': '3', 'num_vm_active': '3', 'num_task_None': '2', 'num_os_type_None': '3', 'num_proj_8428b9d1e48c42f690612bf1e012ec42': '2', 'io_workload': '0', 'num_task_deleting': '1', 'num_proj_c55032abafa74d4facac03929da4a366': '1'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:08:18.449031 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:08:18.633275 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:18.717835 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Took 1.33 seconds to destroy the instance on the hypervisor. Jan 26 19:08:18.723837 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:08:18.723837 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:08:18.723837 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:08:18.723837 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:18.777828 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:18.952475 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:08:19.167255 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "bac486a0-2e8d-4ff3-a660-229cf25b0328" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:19.167679 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "bac486a0-2e8d-4ff3-a660-229cf25b0328" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:19.355412 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-30cf51d1-cf4b-4253-bd58-3a9773e361c8 req-f5131322-6d83-4181-9498-0b51a086a8b6 service nova] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Received event network-vif-deleted-3ffd86c4-b487-449b-9277-55f5ae19d100 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:08:19.357817 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-30cf51d1-cf4b-4253-bd58-3a9773e361c8 req-f5131322-6d83-4181-9498-0b51a086a8b6 service nova] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Neutron deleted interface 3ffd86c4-b487-449b-9277-55f5ae19d100; detaching it from the instance and deleting it from the info cache Jan 26 19:08:19.357817 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-30cf51d1-cf4b-4253-bd58-3a9773e361c8 req-f5131322-6d83-4181-9498-0b51a086a8b6 service nova] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:08:19.459195 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:08:19.459338 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.211s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:19.672328 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:08:19.825754 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:08:19.859698 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-30cf51d1-cf4b-4253-bd58-3a9773e361c8 req-f5131322-6d83-4181-9498-0b51a086a8b6 service nova] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Detach interface failed, port_id=3ffd86c4-b487-449b-9277-55f5ae19d100, reason: Instance b7041c4d-2e69-4988-bd5d-a9e302629220 could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:08:20.082849 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:08:20.082849 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] VM Stopped (Lifecycle Event) Jan 26 19:08:20.214321 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:20.214637 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:20.218970 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:08:20.219222 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Claim successful on node np0005596550.novalocal Jan 26 19:08:20.329396 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Took 1.61 seconds to deallocate network for instance. Jan 26 19:08:20.350109 np0005596550.novalocal nova-compute[189076]: WARNING nova.volume.cinder [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Attachment 751bc286-8f12-4b77-996d-71b7a6814584 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 751bc286-8f12-4b77-996d-71b7a6814584. (HTTP 404) (Request-ID: req-a107e50f-7db0-48fd-ab73-c3e549b6d7d1) Jan 26 19:08:20.350338 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Took 0.02 seconds to detach 1 volumes for instance. Jan 26 19:08:20.460245 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:08:20.460542 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "9d204b32-9530-4994-9cf3-be570ab5f3fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:20.460898 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:20.462034 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:08:20.462557 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:08:20.462746 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:08:20.593851 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-5bbf04b9-430e-48e2-addf-8002f6c77225 None None] [instance: b45e5bd0-6b91-4999-bfb3-df0d0e355d77] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:20.858900 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:20.965289 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:08:21.409114 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:08:21.503319 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:21.895261 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:08:21.895823 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:08:21.915448 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:08:22.113683 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:22.424096 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.209s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:22.424670 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:08:22.428700 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.572s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:22.652652 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:08:22.891669 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:08:22.895215 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:08:22.959389 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:08:22.959389 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:08:22.959389 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:22.959389 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:22.997088 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8369268788c24337ade1739d948c300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428b9d1e48c42f690612bf1e012ec42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:08:23.157551 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:08:23.176309 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:23.435896 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:08:23.440543 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Successfully created port: c6f1481d-32b0-412b-9ca7-a4087cbd65ff {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:08:23.663891 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.235s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:23.690231 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.187s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:23.695421 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:08:23.695815 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Claim successful on node np0005596550.novalocal Jan 26 19:08:23.736271 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Deleted allocations for instance b7041c4d-2e69-4988-bd5d-a9e302629220 Jan 26 19:08:23.847519 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Successfully updated port: c6f1481d-32b0-412b-9ca7-a4087cbd65ff {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:08:23.879090 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ef203ab5-ffbe-40fd-a718-65d71c77a4bb req-0ce75830-0b2a-4c52-a013-99ed5d1d96f0 service nova] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Received event network-changed-c6f1481d-32b0-412b-9ca7-a4087cbd65ff {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:08:23.879335 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ef203ab5-ffbe-40fd-a718-65d71c77a4bb req-0ce75830-0b2a-4c52-a013-99ed5d1d96f0 service nova] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Refreshing instance network info cache due to event network-changed-c6f1481d-32b0-412b-9ca7-a4087cbd65ff. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:08:23.879575 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ef203ab5-ffbe-40fd-a718-65d71c77a4bb req-0ce75830-0b2a-4c52-a013-99ed5d1d96f0 service nova] Acquiring lock "refresh_cache-bac486a0-2e8d-4ff3-a660-229cf25b0328" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:08:23.879886 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ef203ab5-ffbe-40fd-a718-65d71c77a4bb req-0ce75830-0b2a-4c52-a013-99ed5d1d96f0 service nova] Acquired lock "refresh_cache-bac486a0-2e8d-4ff3-a660-229cf25b0328" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:08:23.880245 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-ef203ab5-ffbe-40fd-a718-65d71c77a4bb req-0ce75830-0b2a-4c52-a013-99ed5d1d96f0 service nova] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Refreshing network info cache for port c6f1481d-32b0-412b-9ca7-a4087cbd65ff {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:08:23.968930 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:08:24.350619 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "refresh_cache-bac486a0-2e8d-4ff3-a660-229cf25b0328" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:08:24.384399 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-ef203ab5-ffbe-40fd-a718-65d71c77a4bb req-0ce75830-0b2a-4c52-a013-99ed5d1d96f0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:24.560002 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-ef203ab5-ffbe-40fd-a718-65d71c77a4bb req-0ce75830-0b2a-4c52-a013-99ed5d1d96f0 service nova] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:08:24.757054 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-cb528a99-b0bb-41b5-a482-fd3e4b0d2a4f tempest-VolumesSnapshotTestJSON-666453103 tempest-VolumesSnapshotTestJSON-666453103-project-member] Lock "b7041c4d-2e69-4988-bd5d-a9e302629220" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.884s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:24.853883 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-ef203ab5-ffbe-40fd-a718-65d71c77a4bb req-0ce75830-0b2a-4c52-a013-99ed5d1d96f0 service nova] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:08:24.869027 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:08:24.978373 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:08:24.979216 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:08:24.979404 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Creating image(s) Jan 26 19:08:24.979855 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "/opt/stack/data/nova/instances/bac486a0-2e8d-4ff3-a660-229cf25b0328/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:24.980032 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "/opt/stack/data/nova/instances/bac486a0-2e8d-4ff3-a660-229cf25b0328/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:24.980512 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "/opt/stack/data/nova/instances/bac486a0-2e8d-4ff3-a660-229cf25b0328/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:24.980973 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:08:24.983658 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:08:24.984706 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:25.072183 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.087s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:25.072539 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:25.074243 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:25.074926 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:08:25.078720 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:08:25.079131 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:25.182331 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.101s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:25.182331 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/bac486a0-2e8d-4ff3-a660-229cf25b0328/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:25.226111 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/bac486a0-2e8d-4ff3-a660-229cf25b0328/disk 1073741824" returned: 0 in 0.045s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:25.226859 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.154s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:25.227422 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:25.313541 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.086s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:25.314272 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bac486a0-2e8d-4ff3-a660-229cf25b0328/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:08:25.314899 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac486a0-2e8d-4ff3-a660-229cf25b0328/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:25.358189 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ef203ab5-ffbe-40fd-a718-65d71c77a4bb req-0ce75830-0b2a-4c52-a013-99ed5d1d96f0 service nova] Releasing lock "refresh_cache-bac486a0-2e8d-4ff3-a660-229cf25b0328" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:08:25.359343 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquired lock "refresh_cache-bac486a0-2e8d-4ff3-a660-229cf25b0328" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:08:25.359804 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:08:25.372263 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:08:25.403263 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac486a0-2e8d-4ff3-a660-229cf25b0328/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:25.406763 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Cannot resize image /opt/stack/data/nova/instances/bac486a0-2e8d-4ff3-a660-229cf25b0328/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:08:25.407966 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:08:25.407966 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Ensure instance console log exists: /opt/stack/data/nova/instances/bac486a0-2e8d-4ff3-a660-229cf25b0328/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:08:25.407966 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:25.408225 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:25.408497 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:25.885239 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.195s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:25.885940 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:08:25.936956 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:08:26.066286 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:26.208396 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Updating instance_info_cache with network_info: [{"id": "c6f1481d-32b0-412b-9ca7-a4087cbd65ff", "address": "fa:16:3e:07:ec:9e", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f1481d-32", "ovs_interfaceid": "c6f1481d-32b0-412b-9ca7-a4087cbd65ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:08:26.397028 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:08:26.397405 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:08:26.398044 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:26.398696 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:26.457615 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12364a81a9ea43658a098cdfdb50e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fd2a7189d04227bf250a5dcfbc5d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:08:26.713327 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Releasing lock "refresh_cache-bac486a0-2e8d-4ff3-a660-229cf25b0328" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:08:26.713805 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Instance network_info: |[{"id": "c6f1481d-32b0-412b-9ca7-a4087cbd65ff", "address": "fa:16:3e:07:ec:9e", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f1481d-32", "ovs_interfaceid": "c6f1481d-32b0-412b-9ca7-a4087cbd65ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:08:26.719510 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Start _get_guest_xml network_info=[{"id": "c6f1481d-32b0-412b-9ca7-a4087cbd65ff", "address": "fa:16:3e:07:ec:9e", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f1481d-32", "ovs_interfaceid": "c6f1481d-32b0-412b-9ca7-a4087cbd65ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:08:26.736746 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:08:26.738446 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-993334793', uuid='bac486a0-2e8d-4ff3-a660-229cf25b0328'), owner=OwnerMeta(userid='8369268788c24337ade1739d948c300a', username='tempest-ServerActionsTestOtherB-1262198412-project-member', projectid='8428b9d1e48c42f690612bf1e012ec42', projectname='tempest-ServerActionsTestOtherB-1262198412'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c6f1481d-32b0-412b-9ca7-a4087cbd65ff", "address": "fa:16:3e:07:ec:9e", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f1481d-32", "ovs_interfaceid": "c6f1481d-32b0-412b-9ca7-a4087cbd65ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472506.7377136) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:08:26.740068 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:08:26.740475 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:08:26.742195 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:08:26.742195 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:08:26.743202 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:08:26.743691 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:08:26.743909 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:08:26.744115 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:08:26.744326 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:08:26.744910 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:08:26.744910 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:08:26.745466 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:08:26.746950 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:08:26.747360 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:08:26.747733 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:08:26.748000 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:08:26.755993 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-993334793',display_name='tempest-ServerActionsTestOtherB-server-993334793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-993334793',id=76,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-sm6y69ze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:08:24Z,user_data=None,user_id='8369268788c24337ade1739d948c300a',uuid=bac486a0-2e8d-4ff3-a660-229cf25b0328,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6f1481d-32b0-412b-9ca7-a4087cbd65ff", "address": "fa:16:3e:07:ec:9e", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f1481d-32", "ovs_interfaceid": "c6f1481d-32b0-412b-9ca7-a4087cbd65ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:08:26.756366 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "c6f1481d-32b0-412b-9ca7-a4087cbd65ff", "address": "fa:16:3e:07:ec:9e", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f1481d-32", "ovs_interfaceid": "c6f1481d-32b0-412b-9ca7-a4087cbd65ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:08:26.757866 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:ec:9e,bridge_name='br-int',has_traffic_filtering=True,id=c6f1481d-32b0-412b-9ca7-a4087cbd65ff,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f1481d-32') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:08:26.758701 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'pci_devices' on Instance uuid bac486a0-2e8d-4ff3-a660-229cf25b0328 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:08:26.803551 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Successfully created port: b7a8b8a6-13a1-4ba2-95d3-3966f872148e {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:08:26.903176 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:08:27.115001 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:27.219130 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Successfully updated port: b7a8b8a6-13a1-4ba2-95d3-3966f872148e {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:08:27.252464 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5719a047-ba05-4af0-95ef-3e31d2352c36 req-8219b1b0-04f0-4852-bc09-a87937cb66e0 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Received event network-changed-b7a8b8a6-13a1-4ba2-95d3-3966f872148e {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:08:27.252464 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5719a047-ba05-4af0-95ef-3e31d2352c36 req-8219b1b0-04f0-4852-bc09-a87937cb66e0 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Refreshing instance network info cache due to event network-changed-b7a8b8a6-13a1-4ba2-95d3-3966f872148e. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:08:27.252464 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5719a047-ba05-4af0-95ef-3e31d2352c36 req-8219b1b0-04f0-4852-bc09-a87937cb66e0 service nova] Acquiring lock "refresh_cache-9d204b32-9530-4994-9cf3-be570ab5f3fc" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:08:27.252611 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5719a047-ba05-4af0-95ef-3e31d2352c36 req-8219b1b0-04f0-4852-bc09-a87937cb66e0 service nova] Acquired lock "refresh_cache-9d204b32-9530-4994-9cf3-be570ab5f3fc" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:08:27.253490 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-5719a047-ba05-4af0-95ef-3e31d2352c36 req-8219b1b0-04f0-4852-bc09-a87937cb66e0 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Refreshing network info cache for port b7a8b8a6-13a1-4ba2-95d3-3966f872148e {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] End _get_guest_xml xml= Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: bac486a0-2e8d-4ff3-a660-229cf25b0328 Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: instance-0000004c Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-server-993334793 Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:08:26 Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-1262198412-project-member Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-1262198412 Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: bac486a0-2e8d-4ff3-a660-229cf25b0328 Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: bac486a0-2e8d-4ff3-a660-229cf25b0328 Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:27.265044 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:08:27.267983 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Preparing to wait for external event network-vif-plugged-c6f1481d-32b0-412b-9ca7-a4087cbd65ff {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:08:27.267983 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "bac486a0-2e8d-4ff3-a660-229cf25b0328-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:27.267983 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "bac486a0-2e8d-4ff3-a660-229cf25b0328-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:27.267983 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "bac486a0-2e8d-4ff3-a660-229cf25b0328-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:27.267983 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-993334793',display_name='tempest-ServerActionsTestOtherB-server-993334793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-993334793',id=76,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-sm6y69ze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:08:24Z,user_data=None,user_id='8369268788c24337ade1739d948c300a',uuid=bac486a0-2e8d-4ff3-a660-229cf25b0328,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6f1481d-32b0-412b-9ca7-a4087cbd65ff", "address": "fa:16:3e:07:ec:9e", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f1481d-32", "ovs_interfaceid": "c6f1481d-32b0-412b-9ca7-a4087cbd65ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:08:27.268276 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "c6f1481d-32b0-412b-9ca7-a4087cbd65ff", "address": "fa:16:3e:07:ec:9e", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f1481d-32", "ovs_interfaceid": "c6f1481d-32b0-412b-9ca7-a4087cbd65ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:08:27.268276 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:ec:9e,bridge_name='br-int',has_traffic_filtering=True,id=c6f1481d-32b0-412b-9ca7-a4087cbd65ff,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f1481d-32') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:08:27.268710 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:ec:9e,bridge_name='br-int',has_traffic_filtering=True,id=c6f1481d-32b0-412b-9ca7-a4087cbd65ff,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f1481d-32') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:08:27.269444 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:27.269988 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:08:27.270262 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:08:27.271806 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:27.272168 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19f2bdb2-bbc7-54c9-b531-27e8d0e15e2e', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:08:27.273300 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:27.275239 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:08:27.277471 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:27.277471 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6f1481d-32, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:08:27.277471 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc6f1481d-32, col_values=(('qos', UUID('cbcff893-7f6b-42b9-8b3c-e1fa7e0e9f17')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:08:27.277601 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc6f1481d-32, col_values=(('external_ids', {'iface-id': 'c6f1481d-32b0-412b-9ca7-a4087cbd65ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:ec:9e', 'vm-uuid': 'bac486a0-2e8d-4ff3-a660-229cf25b0328'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:08:27.278255 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:27.281794 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:08:27.286818 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:27.287718 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:ec:9e,bridge_name='br-int',has_traffic_filtering=True,id=c6f1481d-32b0-412b-9ca7-a4087cbd65ff,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f1481d-32') Jan 26 19:08:27.406459 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:08:27.723376 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "refresh_cache-9d204b32-9530-4994-9cf3-be570ab5f3fc" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:08:27.755651 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-5719a047-ba05-4af0-95ef-3e31d2352c36 req-8219b1b0-04f0-4852-bc09-a87937cb66e0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:27.842120 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-5719a047-ba05-4af0-95ef-3e31d2352c36 req-8219b1b0-04f0-4852-bc09-a87937cb66e0 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:08:27.939109 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-5719a047-ba05-4af0-95ef-3e31d2352c36 req-8219b1b0-04f0-4852-bc09-a87937cb66e0 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:08:28.414118 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:08:28.415053 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:08:28.415380 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Creating image(s) Jan 26 19:08:28.415807 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d204b32-9530-4994-9cf3-be570ab5f3fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:28.416036 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "/opt/stack/data/nova/instances/9d204b32-9530-4994-9cf3-be570ab5f3fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:28.416602 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "/opt/stack/data/nova/instances/9d204b32-9530-4994-9cf3-be570ab5f3fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:28.417206 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:08:28.420782 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:08:28.422648 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:28.442749 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5719a047-ba05-4af0-95ef-3e31d2352c36 req-8219b1b0-04f0-4852-bc09-a87937cb66e0 service nova] Releasing lock "refresh_cache-9d204b32-9530-4994-9cf3-be570ab5f3fc" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:08:28.443030 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquired lock "refresh_cache-9d204b32-9530-4994-9cf3-be570ab5f3fc" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:08:28.444485 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:08:28.525806 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.101s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:28.525806 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:28.525806 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:28.525806 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:08:28.527297 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:08:28.527714 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:28.605046 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.074s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:28.605046 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/9d204b32-9530-4994-9cf3-be570ab5f3fc/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:28.659060 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/9d204b32-9530-4994-9cf3-be570ab5f3fc/disk 1073741824" returned: 0 in 0.053s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:28.659060 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.133s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:28.659060 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:28.736806 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.076s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:28.736806 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d204b32-9530-4994-9cf3-be570ab5f3fc/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:08:28.736806 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d204b32-9530-4994-9cf3-be570ab5f3fc/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:28.809868 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d204b32-9530-4994-9cf3-be570ab5f3fc/disk --force-share --output=json" returned: 0 in 0.071s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:28.809868 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Cannot resize image /opt/stack/data/nova/instances/9d204b32-9530-4994-9cf3-be570ab5f3fc/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:08:28.809868 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:08:28.809868 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Ensure instance console log exists: /opt/stack/data/nova/instances/9d204b32-9530-4994-9cf3-be570ab5f3fc/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:08:28.810614 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:28.811241 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:28.811714 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:28.815761 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:08:28.816304 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:08:28.816704 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No VIF found with MAC fa:16:3e:07:ec:9e, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:08:28.817817 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Using config drive Jan 26 19:08:29.076869 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:08:29.192924 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:29.286526 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Updating instance_info_cache with network_info: [{"id": "b7a8b8a6-13a1-4ba2-95d3-3966f872148e", "address": "fa:16:3e:13:1f:e6", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a8b8a6-13", "ovs_interfaceid": "b7a8b8a6-13a1-4ba2-95d3-3966f872148e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:08:29.327787 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:29.397806 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Creating config drive at /opt/stack/data/nova/instances/bac486a0-2e8d-4ff3-a660-229cf25b0328/disk.config Jan 26 19:08:29.401080 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/bac486a0-2e8d-4ff3-a660-229cf25b0328/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp7gx8989c {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:29.521388 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/bac486a0-2e8d-4ff3-a660-229cf25b0328/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp7gx8989c" returned: 0 in 0.120s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:29.599853 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:29.607471 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:29.613363 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:29.719124 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:29.720229 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:29.790813 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Releasing lock "refresh_cache-9d204b32-9530-4994-9cf3-be570ab5f3fc" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:08:29.791232 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Instance network_info: |[{"id": "b7a8b8a6-13a1-4ba2-95d3-3966f872148e", "address": "fa:16:3e:13:1f:e6", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a8b8a6-13", "ovs_interfaceid": "b7a8b8a6-13a1-4ba2-95d3-3966f872148e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:08:29.795665 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Start _get_guest_xml network_info=[{"id": "b7a8b8a6-13a1-4ba2-95d3-3966f872148e", "address": "fa:16:3e:13:1f:e6", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a8b8a6-13", "ovs_interfaceid": "b7a8b8a6-13a1-4ba2-95d3-3966f872148e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:08:29.801293 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:08:29.807904 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-₡-794500751', uuid='9d204b32-9530-4994-9cf3-be570ab5f3fc'), owner=OwnerMeta(userid='12364a81a9ea43658a098cdfdb50e3e3', username='tempest-ServersTestJSON-1441848345-project-member', projectid='06fd2a7189d04227bf250a5dcfbc5d96', projectname='tempest-ServersTestJSON-1441848345'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b7a8b8a6-13a1-4ba2-95d3-3966f872148e", "address": "fa:16:3e:13:1f:e6", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a8b8a6-13", "ovs_interfaceid": "b7a8b8a6-13a1-4ba2-95d3-3966f872148e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472509.8025053) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:08:29.811585 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:08:29.812276 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:08:29.814330 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:08:29.814953 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:08:29.816802 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:08:29.817533 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:08:29.817982 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:08:29.818265 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:08:29.818572 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:08:29.818855 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:08:29.819150 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:08:29.819539 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:08:29.819849 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:08:29.820156 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:08:29.820435 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:08:29.820724 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:08:29.828317 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:08:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-₡-794500751',display_name='tempest-₡-794500751',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest--794500751',id=77,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06fd2a7189d04227bf250a5dcfbc5d96',ramdisk_id='',reservation_id='r-acxf5dba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersTestJSON-1441848345',owner_user_name='tempest-ServersTestJSON-1441848345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:08:27Z,user_data=None,user_id='12364a81a9ea43658a098cdfdb50e3e3',uuid=9d204b32-9530-4994-9cf3-be570ab5f3fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7a8b8a6-13a1-4ba2-95d3-3966f872148e", "address": "fa:16:3e:13:1f:e6", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a8b8a6-13", "ovs_interfaceid": "b7a8b8a6-13a1-4ba2-95d3-3966f872148e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:08:29.828429 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converting VIF {"id": "b7a8b8a6-13a1-4ba2-95d3-3966f872148e", "address": "fa:16:3e:13:1f:e6", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a8b8a6-13", "ovs_interfaceid": "b7a8b8a6-13a1-4ba2-95d3-3966f872148e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:08:29.829546 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:1f:e6,bridge_name='br-int',has_traffic_filtering=True,id=b7a8b8a6-13a1-4ba2-95d3-3966f872148e,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a8b8a6-13') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:08:29.830548 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d204b32-9530-4994-9cf3-be570ab5f3fc {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:08:29.887969 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:08:29.888331 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] VM Started (Lifecycle Event) Jan 26 19:08:30.126029 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b39b0da7-2077-4889-885b-2d8f1bad342c req-ace29b7e-4230-4733-9fc4-4478b7fc77e1 service nova] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Received event network-vif-plugged-c6f1481d-32b0-412b-9ca7-a4087cbd65ff {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:08:30.126308 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b39b0da7-2077-4889-885b-2d8f1bad342c req-ace29b7e-4230-4733-9fc4-4478b7fc77e1 service nova] Acquiring lock "bac486a0-2e8d-4ff3-a660-229cf25b0328-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:30.126669 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b39b0da7-2077-4889-885b-2d8f1bad342c req-ace29b7e-4230-4733-9fc4-4478b7fc77e1 service nova] Lock "bac486a0-2e8d-4ff3-a660-229cf25b0328-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:30.126669 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b39b0da7-2077-4889-885b-2d8f1bad342c req-ace29b7e-4230-4733-9fc4-4478b7fc77e1 service nova] Lock "bac486a0-2e8d-4ff3-a660-229cf25b0328-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:30.126900 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b39b0da7-2077-4889-885b-2d8f1bad342c req-ace29b7e-4230-4733-9fc4-4478b7fc77e1 service nova] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Processing event network-vif-plugged-c6f1481d-32b0-412b-9ca7-a4087cbd65ff {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:08:30.127631 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:08:30.133573 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:08:30.142543 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Instance spawned successfully. Jan 26 19:08:30.142900 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] End _get_guest_xml xml= Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: 9d204b32-9530-4994-9cf3-be570ab5f3fc Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: instance-0000004d Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: tempest-₡-794500751 Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:08:29 Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: tempest-ServersTestJSON-1441848345-project-member Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: tempest-ServersTestJSON-1441848345 Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: 9d204b32-9530-4994-9cf3-be570ab5f3fc Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: 9d204b32-9530-4994-9cf3-be570ab5f3fc Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:30.335394 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:08:30.336646 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Preparing to wait for external event network-vif-plugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:08:30.336646 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:30.336646 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:30.336646 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:30.337866 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:08:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-₡-794500751',display_name='tempest-₡-794500751',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest--794500751',id=77,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06fd2a7189d04227bf250a5dcfbc5d96',ramdisk_id='',reservation_id='r-acxf5dba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersTestJSON-1441848345',owner_user_name='tempest-ServersTestJSON-1441848345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:08:27Z,user_data=None,user_id='12364a81a9ea43658a098cdfdb50e3e3',uuid=9d204b32-9530-4994-9cf3-be570ab5f3fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7a8b8a6-13a1-4ba2-95d3-3966f872148e", "address": "fa:16:3e:13:1f:e6", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a8b8a6-13", "ovs_interfaceid": "b7a8b8a6-13a1-4ba2-95d3-3966f872148e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:08:30.337866 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converting VIF {"id": "b7a8b8a6-13a1-4ba2-95d3-3966f872148e", "address": "fa:16:3e:13:1f:e6", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a8b8a6-13", "ovs_interfaceid": "b7a8b8a6-13a1-4ba2-95d3-3966f872148e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:08:30.337866 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:1f:e6,bridge_name='br-int',has_traffic_filtering=True,id=b7a8b8a6-13a1-4ba2-95d3-3966f872148e,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a8b8a6-13') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:08:30.338236 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:1f:e6,bridge_name='br-int',has_traffic_filtering=True,id=b7a8b8a6-13a1-4ba2-95d3-3966f872148e,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a8b8a6-13') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:08:30.338614 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:30.338930 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:08:30.339204 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:08:30.339793 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:30.339997 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b3628f6-2979-5edd-ad03-cf04bb85bf42', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:08:30.382369 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:30.383550 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:30.387141 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:30.387324 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7a8b8a6-13, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:08:30.387621 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7a8b8a6-13, col_values=(('qos', UUID('e6fa144a-6ccd-4263-8389-67de099c7084')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:08:30.387796 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7a8b8a6-13, col_values=(('external_ids', {'iface-id': 'b7a8b8a6-13a1-4ba2-95d3-3966f872148e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:1f:e6', 'vm-uuid': '9d204b32-9530-4994-9cf3-be570ab5f3fc'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:08:30.388963 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:30.392304 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:30.392514 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:08:30.397884 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:08:30.399490 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:30.403719 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:1f:e6,bridge_name='br-int',has_traffic_filtering=True,id=b7a8b8a6-13a1-4ba2-95d3-3966f872148e,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a8b8a6-13') Jan 26 19:08:30.654801 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:30.655363 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:30.658443 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:30.658443 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:30.658443 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:30.658756 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:30.905971 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:08:30.906395 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:08:30.906854 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] VM Paused (Lifecycle Event) Jan 26 19:08:31.170304 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Took 6.19 seconds to spawn the instance on the hypervisor. Jan 26 19:08:31.170803 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:31.412027 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:31.417860 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:08:31.418081 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] VM Resumed (Lifecycle Event) Jan 26 19:08:31.685292 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Took 11.51 seconds to build instance. Jan 26 19:08:31.921682 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:31.926143 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:08:31.949837 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:08:31.950198 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:08:31.950579 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] No VIF found with MAC fa:16:3e:13:1f:e6, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:08:31.951529 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Using config drive Jan 26 19:08:32.023521 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-a6edbcef-1ba4-447d-91b2-8e1e07e9528c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Pausing Jan 26 19:08:32.023952 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-a6edbcef-1ba4-447d-91b2-8e1e07e9528c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'flavor' on Instance uuid bac486a0-2e8d-4ff3-a660-229cf25b0328 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:08:32.116703 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:32.187933 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dcd98a69-2865-4c58-bf6f-29e4d5cdf273 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "bac486a0-2e8d-4ff3-a660-229cf25b0328" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 13.020s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:32.431103 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] During sync_power_state the instance has a pending task (pausing). Skip. Jan 26 19:08:32.464785 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:32.550947 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a6edbcef-1ba4-447d-91b2-8e1e07e9528c tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:32.551201 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:08:32.551402 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] VM Paused (Lifecycle Event) Jan 26 19:08:32.574262 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Creating config drive at /opt/stack/data/nova/instances/9d204b32-9530-4994-9cf3-be570ab5f3fc/disk.config Jan 26 19:08:32.578046 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/9d204b32-9530-4994-9cf3-be570ab5f3fc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpafk0hzou {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:32.660068 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:08:32.660171 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] VM Stopped (Lifecycle Event) Jan 26 19:08:32.681845 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-719b0876-0dec-4434-9179-a878c76fd2a5 req-30cab1b0-3919-42be-96b5-94189beed410 service nova] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Received event network-vif-plugged-c6f1481d-32b0-412b-9ca7-a4087cbd65ff {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:08:32.683550 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-719b0876-0dec-4434-9179-a878c76fd2a5 req-30cab1b0-3919-42be-96b5-94189beed410 service nova] Acquiring lock "bac486a0-2e8d-4ff3-a660-229cf25b0328-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:32.683550 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-719b0876-0dec-4434-9179-a878c76fd2a5 req-30cab1b0-3919-42be-96b5-94189beed410 service nova] Lock "bac486a0-2e8d-4ff3-a660-229cf25b0328-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:32.683550 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-719b0876-0dec-4434-9179-a878c76fd2a5 req-30cab1b0-3919-42be-96b5-94189beed410 service nova] Lock "bac486a0-2e8d-4ff3-a660-229cf25b0328-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:32.683550 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-719b0876-0dec-4434-9179-a878c76fd2a5 req-30cab1b0-3919-42be-96b5-94189beed410 service nova] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] No waiting events found dispatching network-vif-plugged-c6f1481d-32b0-412b-9ca7-a4087cbd65ff {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:08:32.683550 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-719b0876-0dec-4434-9179-a878c76fd2a5 req-30cab1b0-3919-42be-96b5-94189beed410 service nova] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Received unexpected event network-vif-plugged-c6f1481d-32b0-412b-9ca7-a4087cbd65ff for instance with vm_state paused and task_state None. Jan 26 19:08:32.706318 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/9d204b32-9530-4994-9cf3-be570ab5f3fc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpafk0hzou" returned: 0 in 0.128s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:32.843920 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:33.055553 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:33.071756 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: active, current task_state: pausing, current DB power_state: 1, VM power_state: 3 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:08:33.166675 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bc6912c9-46b1-45f6-a937-74d31015bf4c None None] [instance: b7041c4d-2e69-4988-bd5d-a9e302629220] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:33.173607 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d8a65977-dcc5-49b4-a631-c4bed25bcb44 req-05711b94-c1d0-4a43-84d8-975056bd68bc service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Received event network-vif-plugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:08:33.173805 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d8a65977-dcc5-49b4-a631-c4bed25bcb44 req-05711b94-c1d0-4a43-84d8-975056bd68bc service nova] Acquiring lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:33.173962 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d8a65977-dcc5-49b4-a631-c4bed25bcb44 req-05711b94-c1d0-4a43-84d8-975056bd68bc service nova] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:33.174106 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d8a65977-dcc5-49b4-a631-c4bed25bcb44 req-05711b94-c1d0-4a43-84d8-975056bd68bc service nova] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:33.174241 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d8a65977-dcc5-49b4-a631-c4bed25bcb44 req-05711b94-c1d0-4a43-84d8-975056bd68bc service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Processing event network-vif-plugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:08:33.174707 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:08:33.180451 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:08:33.183187 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:33.195413 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:33.198228 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Instance spawned successfully. Jan 26 19:08:33.198457 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:08:33.574803 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] During sync_power_state the instance has a pending task (shelving). Skip. Jan 26 19:08:33.576009 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:08:33.576009 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] VM Started (Lifecycle Event) Jan 26 19:08:33.709471 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:33.710956 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:33.710956 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:33.711143 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:33.711535 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:33.712427 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:34.097412 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:34.101105 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:08:34.220011 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Took 5.81 seconds to spawn the instance on the hypervisor. Jan 26 19:08:34.220174 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:34.605223 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:08:34.605223 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:08:34.605223 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] VM Paused (Lifecycle Event) Jan 26 19:08:34.646533 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "bac486a0-2e8d-4ff3-a660-229cf25b0328" by "nova.compute.manager.ComputeManager.shelve_instance..do_shelve_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:34.646755 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "bac486a0-2e8d-4ff3-a660-229cf25b0328" acquired by "nova.compute.manager.ComputeManager.shelve_instance..do_shelve_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:34.647007 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Shelving Jan 26 19:08:34.731844 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Took 13.26 seconds to build instance. Jan 26 19:08:35.110754 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:35.114828 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:08:35.115006 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] VM Resumed (Lifecycle Event) Jan 26 19:08:35.230829 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d97737f2-5cda-4675-a21a-741e45a12b5a req-e3a755a8-b114-45c6-a523-da3c5ac0b5d6 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Received event network-vif-plugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:08:35.230829 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d97737f2-5cda-4675-a21a-741e45a12b5a req-e3a755a8-b114-45c6-a523-da3c5ac0b5d6 service nova] Acquiring lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:35.231084 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d97737f2-5cda-4675-a21a-741e45a12b5a req-e3a755a8-b114-45c6-a523-da3c5ac0b5d6 service nova] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:35.231509 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d97737f2-5cda-4675-a21a-741e45a12b5a req-e3a755a8-b114-45c6-a523-da3c5ac0b5d6 service nova] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:35.232679 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d97737f2-5cda-4675-a21a-741e45a12b5a req-e3a755a8-b114-45c6-a523-da3c5ac0b5d6 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] No waiting events found dispatching network-vif-plugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:08:35.232838 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-d97737f2-5cda-4675-a21a-741e45a12b5a req-e3a755a8-b114-45c6-a523-da3c5ac0b5d6 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Received unexpected event network-vif-plugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e for instance with vm_state active and task_state None. Jan 26 19:08:35.234273 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45ea4066-85fb-4a50-bbf5-cd7edb306dc8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.773s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:35.425568 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:35.618285 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:35.622804 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:08:35.682346 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:35.814818 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:35.819246 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:35.892386 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:35.907043 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:35.943577 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Instance destroyed successfully. Jan 26 19:08:35.943577 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'numa_topology' on Instance uuid bac486a0-2e8d-4ff3-a660-229cf25b0328 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:08:36.071565 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f3629747-2de2-4db3-a40a-8d95528e279b req-cbfe9293-bc91-407f-ae2c-9e4b3e54f66f service nova] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Received event network-vif-unplugged-c6f1481d-32b0-412b-9ca7-a4087cbd65ff {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:08:36.071565 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f3629747-2de2-4db3-a40a-8d95528e279b req-cbfe9293-bc91-407f-ae2c-9e4b3e54f66f service nova] Acquiring lock "bac486a0-2e8d-4ff3-a660-229cf25b0328-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:36.071565 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f3629747-2de2-4db3-a40a-8d95528e279b req-cbfe9293-bc91-407f-ae2c-9e4b3e54f66f service nova] Lock "bac486a0-2e8d-4ff3-a660-229cf25b0328-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:36.071565 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f3629747-2de2-4db3-a40a-8d95528e279b req-cbfe9293-bc91-407f-ae2c-9e4b3e54f66f service nova] Lock "bac486a0-2e8d-4ff3-a660-229cf25b0328-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:36.071565 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f3629747-2de2-4db3-a40a-8d95528e279b req-cbfe9293-bc91-407f-ae2c-9e4b3e54f66f service nova] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] No waiting events found dispatching network-vif-unplugged-c6f1481d-32b0-412b-9ca7-a4087cbd65ff {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:08:36.071565 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-f3629747-2de2-4db3-a40a-8d95528e279b req-cbfe9293-bc91-407f-ae2c-9e4b3e54f66f service nova] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Received unexpected event network-vif-unplugged-c6f1481d-32b0-412b-9ca7-a4087cbd65ff for instance with vm_state paused and task_state shelving. Jan 26 19:08:36.593396 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Beginning cold snapshot process Jan 26 19:08:37.121901 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:38.108816 np0005596550.novalocal nova-compute[189076]: DEBUG nova.privsep.utils [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=189076) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jan 26 19:08:38.109152 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/bac486a0-2e8d-4ff3-a660-229cf25b0328/disk /opt/stack/data/nova/instances/snapshots/tmp4t9dx6zf/029f3c2d1def4dd899623db23d82e35d {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:38.136968 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e0576e7a-f882-47a9-b76d-e906c6d8c06c req-c35cf372-00c4-4ccf-979d-d464939434ac service nova] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Received event network-vif-unplugged-c6f1481d-32b0-412b-9ca7-a4087cbd65ff {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:08:38.137262 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e0576e7a-f882-47a9-b76d-e906c6d8c06c req-c35cf372-00c4-4ccf-979d-d464939434ac service nova] Acquiring lock "bac486a0-2e8d-4ff3-a660-229cf25b0328-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:38.138782 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e0576e7a-f882-47a9-b76d-e906c6d8c06c req-c35cf372-00c4-4ccf-979d-d464939434ac service nova] Lock "bac486a0-2e8d-4ff3-a660-229cf25b0328-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:38.138782 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e0576e7a-f882-47a9-b76d-e906c6d8c06c req-c35cf372-00c4-4ccf-979d-d464939434ac service nova] Lock "bac486a0-2e8d-4ff3-a660-229cf25b0328-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:38.138782 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e0576e7a-f882-47a9-b76d-e906c6d8c06c req-c35cf372-00c4-4ccf-979d-d464939434ac service nova] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] No waiting events found dispatching network-vif-unplugged-c6f1481d-32b0-412b-9ca7-a4087cbd65ff {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:08:38.138888 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-e0576e7a-f882-47a9-b76d-e906c6d8c06c req-c35cf372-00c4-4ccf-979d-d464939434ac service nova] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Received unexpected event network-vif-unplugged-c6f1481d-32b0-412b-9ca7-a4087cbd65ff for instance with vm_state paused and task_state shelving_image_pending_upload. Jan 26 19:08:38.322463 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/bac486a0-2e8d-4ff3-a660-229cf25b0328/disk /opt/stack/data/nova/instances/snapshots/tmp4t9dx6zf/029f3c2d1def4dd899623db23d82e35d" returned: 0 in 0.213s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:38.322719 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Snapshot extracted, beginning image upload Jan 26 19:08:38.461948 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "ddd5e451-9ac4-4b72-920e-20277da4eb44" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:38.461948 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "ddd5e451-9ac4-4b72-920e-20277da4eb44" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:38.966964 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:08:39.542684 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:39.542684 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:39.546659 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:08:39.546814 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Claim successful on node np0005596550.novalocal Jan 26 19:08:40.473307 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:40.870845 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:08:41.374727 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:08:41.880007 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.337s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:41.880508 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:08:42.815269 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Snapshot image upload complete Jan 26 19:08:42.815269 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:42.893879 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:08:42.893879 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:08:42.893879 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:42.894300 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:42.984071 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12364a81a9ea43658a098cdfdb50e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fd2a7189d04227bf250a5dcfbc5d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:08:43.330000 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Shelve offloading Jan 26 19:08:43.396860 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:08:43.527635 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Successfully created port: aad2b361-1dca-4d5e-81b4-5584c086c94a {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:08:43.848156 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Instance destroyed successfully. Jan 26 19:08:43.848585 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:43.852229 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "refresh_cache-bac486a0-2e8d-4ff3-a660-229cf25b0328" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:08:43.852414 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquired lock "refresh_cache-bac486a0-2e8d-4ff3-a660-229cf25b0328" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:08:43.852630 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:08:43.903017 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:08:44.355467 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:44.422754 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Successfully updated port: aad2b361-1dca-4d5e-81b4-5584c086c94a {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:08:44.580333 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-64402763-e38e-4338-8060-196625fa5f61 req-147dde5c-fd18-4976-a77c-39b1832e9a75 service nova] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Received event network-changed-aad2b361-1dca-4d5e-81b4-5584c086c94a {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:08:44.580612 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-64402763-e38e-4338-8060-196625fa5f61 req-147dde5c-fd18-4976-a77c-39b1832e9a75 service nova] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Refreshing instance network info cache due to event network-changed-aad2b361-1dca-4d5e-81b4-5584c086c94a. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:08:44.580846 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-64402763-e38e-4338-8060-196625fa5f61 req-147dde5c-fd18-4976-a77c-39b1832e9a75 service nova] Acquiring lock "refresh_cache-ddd5e451-9ac4-4b72-920e-20277da4eb44" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:08:44.581002 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-64402763-e38e-4338-8060-196625fa5f61 req-147dde5c-fd18-4976-a77c-39b1832e9a75 service nova] Acquired lock "refresh_cache-ddd5e451-9ac4-4b72-920e-20277da4eb44" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:08:44.581181 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-64402763-e38e-4338-8060-196625fa5f61 req-147dde5c-fd18-4976-a77c-39b1832e9a75 service nova] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Refreshing network info cache for port aad2b361-1dca-4d5e-81b4-5584c086c94a {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:08:44.743447 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:44.862796 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Updating instance_info_cache with network_info: [{"id": "c6f1481d-32b0-412b-9ca7-a4087cbd65ff", "address": "fa:16:3e:07:ec:9e", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f1481d-32", "ovs_interfaceid": "c6f1481d-32b0-412b-9ca7-a4087cbd65ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:08:44.915380 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:08:44.917568 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:08:44.918049 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Creating image(s) Jan 26 19:08:44.919005 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "/opt/stack/data/nova/instances/ddd5e451-9ac4-4b72-920e-20277da4eb44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:44.919379 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "/opt/stack/data/nova/instances/ddd5e451-9ac4-4b72-920e-20277da4eb44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:44.920407 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "/opt/stack/data/nova/instances/ddd5e451-9ac4-4b72-920e-20277da4eb44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:44.921466 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:08:44.929072 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:08:44.930191 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "refresh_cache-ddd5e451-9ac4-4b72-920e-20277da4eb44" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:08:44.931429 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:45.015961 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.084s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:45.016478 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:45.017047 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:45.017573 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:08:45.021439 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:08:45.021902 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:45.086136 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-64402763-e38e-4338-8060-196625fa5f61 req-147dde5c-fd18-4976-a77c-39b1832e9a75 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:45.136789 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.115s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:45.137230 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/ddd5e451-9ac4-4b72-920e-20277da4eb44/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:45.150618 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-64402763-e38e-4338-8060-196625fa5f61 req-147dde5c-fd18-4976-a77c-39b1832e9a75 service nova] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:08:45.367556 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Releasing lock "refresh_cache-bac486a0-2e8d-4ff3-a660-229cf25b0328" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:08:45.368174 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:45.368518 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:45.475196 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:08:45.477072 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:08:45.477399 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:08:45.477596 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:08:45.524962 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:45.525319 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:08:45.552647 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-64402763-e38e-4338-8060-196625fa5f61 req-147dde5c-fd18-4976-a77c-39b1832e9a75 service nova] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:08:46.057460 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-64402763-e38e-4338-8060-196625fa5f61 req-147dde5c-fd18-4976-a77c-39b1832e9a75 service nova] Releasing lock "refresh_cache-ddd5e451-9ac4-4b72-920e-20277da4eb44" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:08:46.058405 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquired lock "refresh_cache-ddd5e451-9ac4-4b72-920e-20277da4eb44" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:08:46.058405 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:08:46.236807 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/ddd5e451-9ac4-4b72-920e-20277da4eb44/disk 1073741824" returned: 0 in 1.098s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:46.236807 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 1.218s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:46.236807 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:46.338472 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.102s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:46.338728 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ddd5e451-9ac4-4b72-920e-20277da4eb44/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:08:46.339026 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddd5e451-9ac4-4b72-920e-20277da4eb44/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:46.459524 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddd5e451-9ac4-4b72-920e-20277da4eb44/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:46.459938 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Cannot resize image /opt/stack/data/nova/instances/ddd5e451-9ac4-4b72-920e-20277da4eb44/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:08:46.460270 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:08:46.460478 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Ensure instance console log exists: /opt/stack/data/nova/instances/ddd5e451-9ac4-4b72-920e-20277da4eb44/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:08:46.460861 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:46.461143 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:46.461333 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:46.563072 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Instance destroyed successfully. Jan 26 19:08:46.564793 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'resources' on Instance uuid bac486a0-2e8d-4ff3-a660-229cf25b0328 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:08:46.664987 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:08:46.714455 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5dd640cc-947d-418d-b5f5-d6b8d58fbe3b req-1d3070fb-7546-4d96-8363-4222293fcda2 service nova] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Received event network-changed-c6f1481d-32b0-412b-9ca7-a4087cbd65ff {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:08:46.714605 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5dd640cc-947d-418d-b5f5-d6b8d58fbe3b req-1d3070fb-7546-4d96-8363-4222293fcda2 service nova] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Refreshing instance network info cache due to event network-changed-c6f1481d-32b0-412b-9ca7-a4087cbd65ff. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:08:46.714779 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5dd640cc-947d-418d-b5f5-d6b8d58fbe3b req-1d3070fb-7546-4d96-8363-4222293fcda2 service nova] Acquiring lock "refresh_cache-bac486a0-2e8d-4ff3-a660-229cf25b0328" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:08:46.714890 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5dd640cc-947d-418d-b5f5-d6b8d58fbe3b req-1d3070fb-7546-4d96-8363-4222293fcda2 service nova] Acquired lock "refresh_cache-bac486a0-2e8d-4ff3-a660-229cf25b0328" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:08:46.715030 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-5dd640cc-947d-418d-b5f5-d6b8d58fbe3b req-1d3070fb-7546-4d96-8363-4222293fcda2 service nova] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Refreshing network info cache for port c6f1481d-32b0-412b-9ca7-a4087cbd65ff {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:08:46.794475 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:46.928562 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Updating instance_info_cache with network_info: [{"id": "aad2b361-1dca-4d5e-81b4-5584c086c94a", "address": "fa:16:3e:73:f0:da", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad2b361-1d", "ovs_interfaceid": "aad2b361-1dca-4d5e-81b4-5584c086c94a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:08:47.066335 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Object Instance lazy-loaded attributes: numa_topology,resources {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:08:47.068998 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-993334793',display_name='tempest-ServerActionsTestOtherB-server-993334793',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-993334793',id=76,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:08:31Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=4,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-sm6y69ze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member',shelved_at='2026-01-27T00:08:42.814650',shelved_host='np0005596550.novalocal',shelved_image_id='bcda6132-4ab4-4404-8d13-486bf08b71cf'},tags=,task_state='shelving_offloading',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:08:38Z,user_data=None,user_id='8369268788c24337ade1739d948c300a',uuid=bac486a0-2e8d-4ff3-a660-229cf25b0328,vcpu_model=,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "c6f1481d-32b0-412b-9ca7-a4087cbd65ff", "address": "fa:16:3e:07:ec:9e", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f1481d-32", "ovs_interfaceid": "c6f1481d-32b0-412b-9ca7-a4087cbd65ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:08:47.068998 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "c6f1481d-32b0-412b-9ca7-a4087cbd65ff", "address": "fa:16:3e:07:ec:9e", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f1481d-32", "ovs_interfaceid": "c6f1481d-32b0-412b-9ca7-a4087cbd65ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:08:47.068998 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:ec:9e,bridge_name='br-int',has_traffic_filtering=True,id=c6f1481d-32b0-412b-9ca7-a4087cbd65ff,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f1481d-32') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:08:47.069313 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:ec:9e,bridge_name='br-int',has_traffic_filtering=True,id=c6f1481d-32b0-412b-9ca7-a4087cbd65ff,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f1481d-32') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:08:47.070508 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:47.071715 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6f1481d-32, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:08:47.073703 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:47.075644 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:47.076600 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:47.076815 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbcff893-7f6b-42b9-8b3c-e1fa7e0e9f17) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:08:47.077378 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:47.079785 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:47.084618 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:ec:9e,bridge_name='br-int',has_traffic_filtering=True,id=c6f1481d-32b0-412b-9ca7-a4087cbd65ff,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f1481d-32') Jan 26 19:08:47.084895 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Deleting instance files /opt/stack/data/nova/instances/bac486a0-2e8d-4ff3-a660-229cf25b0328_del Jan 26 19:08:47.085262 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Deletion of /opt/stack/data/nova/instances/bac486a0-2e8d-4ff3-a660-229cf25b0328_del complete Jan 26 19:08:47.121933 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:47.221689 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-5dd640cc-947d-418d-b5f5-d6b8d58fbe3b req-1d3070fb-7546-4d96-8363-4222293fcda2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:47.435180 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Releasing lock "refresh_cache-ddd5e451-9ac4-4b72-920e-20277da4eb44" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:08:47.435584 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Instance network_info: |[{"id": "aad2b361-1dca-4d5e-81b4-5584c086c94a", "address": "fa:16:3e:73:f0:da", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad2b361-1d", "ovs_interfaceid": "aad2b361-1dca-4d5e-81b4-5584c086c94a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:08:47.438469 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Start _get_guest_xml network_info=[{"id": "aad2b361-1dca-4d5e-81b4-5584c086c94a", "address": "fa:16:3e:73:f0:da", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad2b361-1d", "ovs_interfaceid": "aad2b361-1dca-4d5e-81b4-5584c086c94a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:08:47.444444 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:08:47.444566 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServersTestJSON-server-1612243019', uuid='ddd5e451-9ac4-4b72-920e-20277da4eb44'), owner=OwnerMeta(userid='12364a81a9ea43658a098cdfdb50e3e3', username='tempest-ServersTestJSON-1441848345-project-member', projectid='06fd2a7189d04227bf250a5dcfbc5d96', projectname='tempest-ServersTestJSON-1441848345'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "aad2b361-1dca-4d5e-81b4-5584c086c94a", "address": "fa:16:3e:73:f0:da", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad2b361-1d", "ovs_interfaceid": "aad2b361-1dca-4d5e-81b4-5584c086c94a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472527.444003) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:08:47.446181 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:08:47.446478 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:08:47.447563 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:08:47.447962 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:08:47.449158 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:08:47.449596 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:08:47.449847 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:08:47.450017 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:08:47.450235 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:08:47.450410 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:08:47.450586 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:08:47.450836 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:08:47.451715 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:08:47.451715 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:08:47.451715 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:08:47.451715 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:08:47.456105 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=2001:2001::3,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersTestJSON-server-1612243019',display_name='tempest-ServersTestJSON-server-1612243019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstestjson-server-1612243019',id=78,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06fd2a7189d04227bf250a5dcfbc5d96',ramdisk_id='',reservation_id='r-13mga0yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersTestJSON-1441848345',owner_user_name='tempest-ServersTestJSON-1441848345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:08:44Z,user_data=None,user_id='12364a81a9ea43658a098cdfdb50e3e3',uuid=ddd5e451-9ac4-4b72-920e-20277da4eb44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aad2b361-1dca-4d5e-81b4-5584c086c94a", "address": "fa:16:3e:73:f0:da", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad2b361-1d", "ovs_interfaceid": "aad2b361-1dca-4d5e-81b4-5584c086c94a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:08:47.456411 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converting VIF {"id": "aad2b361-1dca-4d5e-81b4-5584c086c94a", "address": "fa:16:3e:73:f0:da", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad2b361-1d", "ovs_interfaceid": "aad2b361-1dca-4d5e-81b4-5584c086c94a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:08:47.457087 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:f0:da,bridge_name='br-int',has_traffic_filtering=True,id=aad2b361-1dca-4d5e-81b4-5584c086c94a,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad2b361-1d') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:08:47.457755 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lazy-loading 'pci_devices' on Instance uuid ddd5e451-9ac4-4b72-920e-20277da4eb44 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:08:47.510887 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-5dd640cc-947d-418d-b5f5-d6b8d58fbe3b req-1d3070fb-7546-4d96-8363-4222293fcda2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:47.666080 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-5dd640cc-947d-418d-b5f5-d6b8d58fbe3b req-1d3070fb-7546-4d96-8363-4222293fcda2 service nova] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Updated VIF entry in instance network info cache for port c6f1481d-32b0-412b-9ca7-a4087cbd65ff. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:08:47.666080 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-5dd640cc-947d-418d-b5f5-d6b8d58fbe3b req-1d3070fb-7546-4d96-8363-4222293fcda2 service nova] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Updating instance_info_cache with network_info: [{"id": "c6f1481d-32b0-412b-9ca7-a4087cbd65ff", "address": "fa:16:3e:07:ec:9e", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": null, "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc6f1481d-32", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:08:47.667827 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Deleted allocations for instance bac486a0-2e8d-4ff3-a660-229cf25b0328 Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] End _get_guest_xml xml= Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: ddd5e451-9ac4-4b72-920e-20277da4eb44 Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: instance-0000004e Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: tempest-ServersTestJSON-server-1612243019 Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:08:47 Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: tempest-ServersTestJSON-1441848345-project-member Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: tempest-ServersTestJSON-1441848345 Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: ddd5e451-9ac4-4b72-920e-20277da4eb44 Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: ddd5e451-9ac4-4b72-920e-20277da4eb44 Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Preparing to wait for external event network-vif-plugged-aad2b361-1dca-4d5e-81b4-5584c086c94a {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "ddd5e451-9ac4-4b72-920e-20277da4eb44-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:47.969018 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "ddd5e451-9ac4-4b72-920e-20277da4eb44-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:47.972225 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "ddd5e451-9ac4-4b72-920e-20277da4eb44-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:47.972225 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=2001:2001::3,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersTestJSON-server-1612243019',display_name='tempest-ServersTestJSON-server-1612243019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstestjson-server-1612243019',id=78,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06fd2a7189d04227bf250a5dcfbc5d96',ramdisk_id='',reservation_id='r-13mga0yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersTestJSON-1441848345',owner_user_name='tempest-ServersTestJSON-1441848345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:08:44Z,user_data=None,user_id='12364a81a9ea43658a098cdfdb50e3e3',uuid=ddd5e451-9ac4-4b72-920e-20277da4eb44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aad2b361-1dca-4d5e-81b4-5584c086c94a", "address": "fa:16:3e:73:f0:da", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad2b361-1d", "ovs_interfaceid": "aad2b361-1dca-4d5e-81b4-5584c086c94a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:08:47.972225 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converting VIF {"id": "aad2b361-1dca-4d5e-81b4-5584c086c94a", "address": "fa:16:3e:73:f0:da", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad2b361-1d", "ovs_interfaceid": "aad2b361-1dca-4d5e-81b4-5584c086c94a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:08:47.972554 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:f0:da,bridge_name='br-int',has_traffic_filtering=True,id=aad2b361-1dca-4d5e-81b4-5584c086c94a,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad2b361-1d') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:08:47.976232 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:f0:da,bridge_name='br-int',has_traffic_filtering=True,id=aad2b361-1dca-4d5e-81b4-5584c086c94a,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad2b361-1d') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:08:47.976232 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:47.976232 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:08:47.976232 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:08:47.976562 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:47.977217 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b195666c-52f4-5a65-a09b-5a2fd54a00ff', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:08:47.979158 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:47.982199 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:47.990820 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:47.990820 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaad2b361-1d, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:08:47.990820 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaad2b361-1d, col_values=(('qos', UUID('fc583cf2-5156-4e23-84c6-4d8b99dda1d2')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:08:47.991101 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaad2b361-1d, col_values=(('external_ids', {'iface-id': 'aad2b361-1dca-4d5e-81b4-5584c086c94a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:f0:da', 'vm-uuid': 'ddd5e451-9ac4-4b72-920e-20277da4eb44'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:08:47.993414 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:47.999637 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:08:48.007111 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:48.009965 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:f0:da,bridge_name='br-int',has_traffic_filtering=True,id=aad2b361-1dca-4d5e-81b4-5584c086c94a,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad2b361-1d') Jan 26 19:08:48.173299 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5dd640cc-947d-418d-b5f5-d6b8d58fbe3b req-1d3070fb-7546-4d96-8363-4222293fcda2 service nova] Releasing lock "refresh_cache-bac486a0-2e8d-4ff3-a660-229cf25b0328" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:08:48.676634 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:48.676634 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:49.027069 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:08:49.531631 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:08:49.749577 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:08:49.749990 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:08:49.750265 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] No VIF found with MAC fa:16:3e:73:f0:da, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:08:49.751155 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Using config drive Jan 26 19:08:50.042799 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.365s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:50.264935 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:50.388787 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Creating config drive at /opt/stack/data/nova/instances/ddd5e451-9ac4-4b72-920e-20277da4eb44/disk.config Jan 26 19:08:50.392480 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/ddd5e451-9ac4-4b72-920e-20277da4eb44/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpmrtkabxe {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:50.529347 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/ddd5e451-9ac4-4b72-920e-20277da4eb44/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpmrtkabxe" returned: 0 in 0.137s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:50.552566 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6a4e5d68-fbe8-4f9a-a646-6e800660b5c4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "bac486a0-2e8d-4ff3-a660-229cf25b0328" "released" by "nova.compute.manager.ComputeManager.shelve_instance..do_shelve_instance" :: held 15.906s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:50.670654 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:50.687018 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:50.904686 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:50.908529 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:50.989890 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:08:50.989890 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] VM Started (Lifecycle Event) Jan 26 19:08:51.026860 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a510ff58-9d03-4d58-9066-be91f566dcaf req-10d7f109-a11b-4d66-99b7-66f6bedf4f89 service nova] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Received event network-vif-plugged-aad2b361-1dca-4d5e-81b4-5584c086c94a {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:08:51.026860 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a510ff58-9d03-4d58-9066-be91f566dcaf req-10d7f109-a11b-4d66-99b7-66f6bedf4f89 service nova] Acquiring lock "ddd5e451-9ac4-4b72-920e-20277da4eb44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:51.028504 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a510ff58-9d03-4d58-9066-be91f566dcaf req-10d7f109-a11b-4d66-99b7-66f6bedf4f89 service nova] Lock "ddd5e451-9ac4-4b72-920e-20277da4eb44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:51.028685 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a510ff58-9d03-4d58-9066-be91f566dcaf req-10d7f109-a11b-4d66-99b7-66f6bedf4f89 service nova] Lock "ddd5e451-9ac4-4b72-920e-20277da4eb44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:51.028873 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a510ff58-9d03-4d58-9066-be91f566dcaf req-10d7f109-a11b-4d66-99b7-66f6bedf4f89 service nova] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Processing event network-vif-plugged-aad2b361-1dca-4d5e-81b4-5584c086c94a {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:08:51.029637 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:08:51.039669 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:08:51.044238 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Instance spawned successfully. Jan 26 19:08:51.044672 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:08:51.127159 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:08:51.127363 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] VM Stopped (Lifecycle Event) Jan 26 19:08:51.401564 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" by "nova.compute.manager.ComputeManager.shelve_instance..do_shelve_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:51.401882 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" acquired by "nova.compute.manager.ComputeManager.shelve_instance..do_shelve_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:51.402078 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Shelving Jan 26 19:08:51.495618 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:51.500139 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:08:51.557983 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:51.557983 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:51.557983 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:51.557983 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:51.558617 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:51.558617 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:08:51.630640 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-fdb3583a-17e3-4b38-ae87-8797548da8ae None None] [instance: bac486a0-2e8d-4ff3-a660-229cf25b0328] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:52.003839 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:08:52.004093 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:08:52.004231 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] VM Paused (Lifecycle Event) Jan 26 19:08:52.066874 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Took 7.15 seconds to spawn the instance on the hypervisor. Jan 26 19:08:52.067050 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:52.123921 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:52.444949 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:52.508803 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:52.517905 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:08:52.517905 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] VM Resumed (Lifecycle Event) Jan 26 19:08:52.592096 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Took 13.10 seconds to build instance. Jan 26 19:08:52.615375 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:52.625542 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:52.641619 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f826d814-d2b1-4a38-80a0-15656c84cf5e req-752280bd-0b57-480a-bac9-e704389f9be1 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Received event network-vif-unplugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:08:52.641883 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f826d814-d2b1-4a38-80a0-15656c84cf5e req-752280bd-0b57-480a-bac9-e704389f9be1 service nova] Acquiring lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:52.642099 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f826d814-d2b1-4a38-80a0-15656c84cf5e req-752280bd-0b57-480a-bac9-e704389f9be1 service nova] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:52.642282 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f826d814-d2b1-4a38-80a0-15656c84cf5e req-752280bd-0b57-480a-bac9-e704389f9be1 service nova] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:52.642466 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f826d814-d2b1-4a38-80a0-15656c84cf5e req-752280bd-0b57-480a-bac9-e704389f9be1 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] No waiting events found dispatching network-vif-unplugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:08:52.642688 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-f826d814-d2b1-4a38-80a0-15656c84cf5e req-752280bd-0b57-480a-bac9-e704389f9be1 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Received unexpected event network-vif-unplugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad for instance with vm_state active and task_state shelving. Jan 26 19:08:52.660123 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:52.713692 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Instance destroyed successfully. Jan 26 19:08:52.714364 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'numa_topology' on Instance uuid 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:08:52.993329 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:53.024253 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:53.028209 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:08:53.062599 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-fb26a234-ca9c-471e-895e-8bd78538de91 req-4d8acfaf-4324-4b0e-8f5f-3f48e24be723 service nova] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Received event network-vif-plugged-aad2b361-1dca-4d5e-81b4-5584c086c94a {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:08:53.062599 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fb26a234-ca9c-471e-895e-8bd78538de91 req-4d8acfaf-4324-4b0e-8f5f-3f48e24be723 service nova] Acquiring lock "ddd5e451-9ac4-4b72-920e-20277da4eb44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:53.062599 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fb26a234-ca9c-471e-895e-8bd78538de91 req-4d8acfaf-4324-4b0e-8f5f-3f48e24be723 service nova] Lock "ddd5e451-9ac4-4b72-920e-20277da4eb44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:53.062599 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fb26a234-ca9c-471e-895e-8bd78538de91 req-4d8acfaf-4324-4b0e-8f5f-3f48e24be723 service nova] Lock "ddd5e451-9ac4-4b72-920e-20277da4eb44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:53.062790 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-fb26a234-ca9c-471e-895e-8bd78538de91 req-4d8acfaf-4324-4b0e-8f5f-3f48e24be723 service nova] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] No waiting events found dispatching network-vif-plugged-aad2b361-1dca-4d5e-81b4-5584c086c94a {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:08:53.063018 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-fb26a234-ca9c-471e-895e-8bd78538de91 req-4d8acfaf-4324-4b0e-8f5f-3f48e24be723 service nova] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Received unexpected event network-vif-plugged-aad2b361-1dca-4d5e-81b4-5584c086c94a for instance with vm_state active and task_state None. Jan 26 19:08:53.096006 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ac7c5a98-13a3-4259-974d-463a378f13e8 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "ddd5e451-9ac4-4b72-920e-20277da4eb44" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.635s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:53.317957 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Beginning cold snapshot process Jan 26 19:08:54.249150 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "ddd5e451-9ac4-4b72-920e-20277da4eb44" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:54.249622 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "ddd5e451-9ac4-4b72-920e-20277da4eb44" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:54.249686 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "ddd5e451-9ac4-4b72-920e-20277da4eb44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:54.249927 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "ddd5e451-9ac4-4b72-920e-20277da4eb44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:54.250122 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "ddd5e451-9ac4-4b72-920e-20277da4eb44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:54.253658 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Terminating instance Jan 26 19:08:54.682094 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7fd18467-e714-4b36-bebd-fdad6321485d req-655df48e-2251-498b-8571-0a5c3cf25f5f service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Received event network-vif-unplugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:08:54.682315 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7fd18467-e714-4b36-bebd-fdad6321485d req-655df48e-2251-498b-8571-0a5c3cf25f5f service nova] Acquiring lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:54.682724 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7fd18467-e714-4b36-bebd-fdad6321485d req-655df48e-2251-498b-8571-0a5c3cf25f5f service nova] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:54.683001 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7fd18467-e714-4b36-bebd-fdad6321485d req-655df48e-2251-498b-8571-0a5c3cf25f5f service nova] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:54.683144 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7fd18467-e714-4b36-bebd-fdad6321485d req-655df48e-2251-498b-8571-0a5c3cf25f5f service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] No waiting events found dispatching network-vif-unplugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:08:54.683294 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-7fd18467-e714-4b36-bebd-fdad6321485d req-655df48e-2251-498b-8571-0a5c3cf25f5f service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Received unexpected event network-vif-unplugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad for instance with vm_state active and task_state shelving_image_pending_upload. Jan 26 19:08:54.758876 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:08:54.828491 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:54.834381 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:54.851822 np0005596550.novalocal nova-compute[189076]: DEBUG nova.privsep.utils [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=189076) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jan 26 19:08:54.851822 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk /opt/stack/data/nova/instances/snapshots/tmpg626x344/1c5e200fa5064da993bbf5f9f1f42b09 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:08:54.965088 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:54.974406 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:54.992209 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:55.005887 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:55.048472 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Instance destroyed successfully. Jan 26 19:08:55.048959 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lazy-loading 'resources' on Instance uuid ddd5e451-9ac4-4b72-920e-20277da4eb44 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:08:55.133126 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-1e2a55c6-a45c-4a2e-90a3-b6fc855d69cd req-710efe48-e58f-4c4c-ab7c-2bc3ba7d5f6b service nova] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Received event network-vif-unplugged-aad2b361-1dca-4d5e-81b4-5584c086c94a {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:08:55.133350 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1e2a55c6-a45c-4a2e-90a3-b6fc855d69cd req-710efe48-e58f-4c4c-ab7c-2bc3ba7d5f6b service nova] Acquiring lock "ddd5e451-9ac4-4b72-920e-20277da4eb44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:55.133548 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1e2a55c6-a45c-4a2e-90a3-b6fc855d69cd req-710efe48-e58f-4c4c-ab7c-2bc3ba7d5f6b service nova] Lock "ddd5e451-9ac4-4b72-920e-20277da4eb44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:55.133668 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1e2a55c6-a45c-4a2e-90a3-b6fc855d69cd req-710efe48-e58f-4c4c-ab7c-2bc3ba7d5f6b service nova] Lock "ddd5e451-9ac4-4b72-920e-20277da4eb44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:55.133852 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-1e2a55c6-a45c-4a2e-90a3-b6fc855d69cd req-710efe48-e58f-4c4c-ab7c-2bc3ba7d5f6b service nova] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] No waiting events found dispatching network-vif-unplugged-aad2b361-1dca-4d5e-81b4-5584c086c94a {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:08:55.134295 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-1e2a55c6-a45c-4a2e-90a3-b6fc855d69cd req-710efe48-e58f-4c4c-ab7c-2bc3ba7d5f6b service nova] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Received event network-vif-unplugged-aad2b361-1dca-4d5e-81b4-5584c086c94a for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:08:55.554381 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=2001:2001::3,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServersTestJSON-server-1612243019',display_name='tempest-ServersTestJSON-server-1612243019',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstestjson-server-1612243019',id=78,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:08:52Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='06fd2a7189d04227bf250a5dcfbc5d96',ramdisk_id='',reservation_id='r-13mga0yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersTestJSON-1441848345',owner_user_name='tempest-ServersTestJSON-1441848345-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:08:52Z,user_data=None,user_id='12364a81a9ea43658a098cdfdb50e3e3',uuid=ddd5e451-9ac4-4b72-920e-20277da4eb44,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aad2b361-1dca-4d5e-81b4-5584c086c94a", "address": "fa:16:3e:73:f0:da", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad2b361-1d", "ovs_interfaceid": "aad2b361-1dca-4d5e-81b4-5584c086c94a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:08:55.555184 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converting VIF {"id": "aad2b361-1dca-4d5e-81b4-5584c086c94a", "address": "fa:16:3e:73:f0:da", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad2b361-1d", "ovs_interfaceid": "aad2b361-1dca-4d5e-81b4-5584c086c94a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:08:55.555330 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:f0:da,bridge_name='br-int',has_traffic_filtering=True,id=aad2b361-1dca-4d5e-81b4-5584c086c94a,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad2b361-1d') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:08:55.555723 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:f0:da,bridge_name='br-int',has_traffic_filtering=True,id=aad2b361-1dca-4d5e-81b4-5584c086c94a,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad2b361-1d') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:08:55.560364 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:55.560685 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaad2b361-1d, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:08:55.565010 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:55.567497 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:08:55.573244 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:55.574338 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:55.574674 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fc583cf2-5156-4e23-84c6-4d8b99dda1d2) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:08:55.575548 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:55.576272 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:08:55.583737 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:55.586818 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:f0:da,bridge_name='br-int',has_traffic_filtering=True,id=aad2b361-1dca-4d5e-81b4-5584c086c94a,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad2b361-1d') Jan 26 19:08:55.587376 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Deleting instance files /opt/stack/data/nova/instances/ddd5e451-9ac4-4b72-920e-20277da4eb44_del Jan 26 19:08:55.588276 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Deletion of /opt/stack/data/nova/instances/ddd5e451-9ac4-4b72-920e-20277da4eb44_del complete Jan 26 19:08:56.053615 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk /opt/stack/data/nova/instances/snapshots/tmpg626x344/1c5e200fa5064da993bbf5f9f1f42b09" returned: 0 in 1.203s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:08:56.053888 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Snapshot extracted, beginning image upload Jan 26 19:08:56.104514 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Took 1.34 seconds to destroy the instance on the hypervisor. Jan 26 19:08:56.105299 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:08:56.105548 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:08:56.105749 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:08:56.106060 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:56.179643 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:08:56.931679 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:08:57.158421 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:57.197619 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f250a702-c61d-492c-b1ad-a5813d37d6d0 req-b3cc0d45-8769-496e-9020-19177e8ea48d service nova] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Received event network-vif-unplugged-aad2b361-1dca-4d5e-81b4-5584c086c94a {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:08:57.200915 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f250a702-c61d-492c-b1ad-a5813d37d6d0 req-b3cc0d45-8769-496e-9020-19177e8ea48d service nova] Acquiring lock "ddd5e451-9ac4-4b72-920e-20277da4eb44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:57.201354 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f250a702-c61d-492c-b1ad-a5813d37d6d0 req-b3cc0d45-8769-496e-9020-19177e8ea48d service nova] Lock "ddd5e451-9ac4-4b72-920e-20277da4eb44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.003s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:57.201627 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f250a702-c61d-492c-b1ad-a5813d37d6d0 req-b3cc0d45-8769-496e-9020-19177e8ea48d service nova] Lock "ddd5e451-9ac4-4b72-920e-20277da4eb44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:57.201934 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f250a702-c61d-492c-b1ad-a5813d37d6d0 req-b3cc0d45-8769-496e-9020-19177e8ea48d service nova] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] No waiting events found dispatching network-vif-unplugged-aad2b361-1dca-4d5e-81b4-5584c086c94a {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:08:57.202219 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f250a702-c61d-492c-b1ad-a5813d37d6d0 req-b3cc0d45-8769-496e-9020-19177e8ea48d service nova] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Received event network-vif-unplugged-aad2b361-1dca-4d5e-81b4-5584c086c94a for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:08:57.202458 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f250a702-c61d-492c-b1ad-a5813d37d6d0 req-b3cc0d45-8769-496e-9020-19177e8ea48d service nova] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Received event network-vif-deleted-aad2b361-1dca-4d5e-81b4-5584c086c94a {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:08:57.436688 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Took 1.33 seconds to deallocate network for instance. Jan 26 19:08:57.965758 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:08:57.966190 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:08:58.217762 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:08:58.723034 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:08:58.859891 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Snapshot image upload complete Jan 26 19:08:58.859891 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:59.236794 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.268s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:08:59.290462 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Deleted allocations for instance ddd5e451-9ac4-4b72-920e-20277da4eb44 Jan 26 19:08:59.380081 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Shelve offloading Jan 26 19:08:59.697019 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:08:59.896059 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Instance destroyed successfully. Jan 26 19:08:59.896620 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:08:59.903364 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "refresh_cache-86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:08:59.905804 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquired lock "refresh_cache-86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:08:59.906253 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:09:00.298350 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ccd1dbb1-062c-4b43-b931-ae0a972620a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "ddd5e451-9ac4-4b72-920e-20277da4eb44" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.049s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:00.413915 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:00.577995 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:01.133947 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:01.268086 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Updating instance_info_cache with network_info: [{"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:09:01.770505 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Releasing lock "refresh_cache-86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:09:01.771042 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:01.771042 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:01.899449 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:01.899605 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:02.160287 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:02.246628 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Instance destroyed successfully. Jan 26 19:09:02.246928 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'resources' on Instance uuid 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:09:02.261849 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-8b2adadd-e761-46f6-aa7f-83b542b0bf55 req-d6e0f244-1a05-42fc-994e-697e403ac522 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Received event network-changed-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:09:02.262142 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-8b2adadd-e761-46f6-aa7f-83b542b0bf55 req-d6e0f244-1a05-42fc-994e-697e403ac522 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Refreshing instance network info cache due to event network-changed-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:09:02.262638 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-8b2adadd-e761-46f6-aa7f-83b542b0bf55 req-d6e0f244-1a05-42fc-994e-697e403ac522 service nova] Acquiring lock "refresh_cache-86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:09:02.262911 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-8b2adadd-e761-46f6-aa7f-83b542b0bf55 req-d6e0f244-1a05-42fc-994e-697e403ac522 service nova] Acquired lock "refresh_cache-86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:09:02.262964 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-8b2adadd-e761-46f6-aa7f-83b542b0bf55 req-d6e0f244-1a05-42fc-994e-697e403ac522 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Refreshing network info cache for port 8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:09:02.402940 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:09:02.749839 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Object Instance<86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa> lazy-loaded attributes: numa_topology,resources {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:09:02.750660 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:07:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-979228963',display_name='tempest-ServerActionsTestOtherB-server-979228963',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-979228963',id=74,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK72/fZgFXc8Nm23qFp5bqxu5uQWjdqvi6tf0S8eHH5LAOejrjAG2pg3k7mvst6GtMR5cAEv++XPpoBWMRpc6kXyw3lb+Uukjxykolyr/SPF2WcEU8zRsEYayUYxi/WyQ==',key_name='tempest-keypair-56259378',keypairs=,launch_index=0,launched_at=2026-01-27T00:07:39Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=4,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-bfui779d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member',shelved_at='2026-01-27T00:08:58.859453',shelved_host='np0005596550.novalocal',shelved_image_id='ef1d2273-8c79-45fe-b933-a915d377657a'},tags=,task_state='shelving_offloading',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:08:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa,vcpu_model=,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:09:02.751063 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:09:02.751704 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:03:06,bridge_name='br-int',has_traffic_filtering=True,id=8de29cf0-d7bc-4d33-9f3c-a793ec1426ad,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de29cf0-d7') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:09:02.751990 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:03:06,bridge_name='br-int',has_traffic_filtering=True,id=8de29cf0-d7bc-4d33-9f3c-a793ec1426ad,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de29cf0-d7') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:09:02.753148 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:02.753410 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8de29cf0-d7, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:02.754851 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:02.756916 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:09:02.758122 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:02.758931 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:02.759138 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b74c9a33-6c8e-42ce-9bd1-18e5c9ec07d2) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:02.759879 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:02.761546 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:09:02.762435 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:02.764520 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:03:06,bridge_name='br-int',has_traffic_filtering=True,id=8de29cf0-d7bc-4d33-9f3c-a793ec1426ad,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de29cf0-d7') Jan 26 19:09:02.764939 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Deleting instance files /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa_del Jan 26 19:09:02.770167 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Deletion of /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa_del complete Jan 26 19:09:02.777100 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-8b2adadd-e761-46f6-aa7f-83b542b0bf55 req-d6e0f244-1a05-42fc-994e-697e403ac522 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:02.962429 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:02.962732 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:02.991791 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:09:02.992029 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Claim successful on node np0005596550.novalocal Jan 26 19:09:03.101959 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-8b2adadd-e761-46f6-aa7f-83b542b0bf55 req-d6e0f244-1a05-42fc-994e-697e403ac522 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:03.342708 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-8b2adadd-e761-46f6-aa7f-83b542b0bf55 req-d6e0f244-1a05-42fc-994e-697e403ac522 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Updated VIF entry in instance network info cache for port 8de29cf0-d7bc-4d33-9f3c-a793ec1426ad. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:09:03.343354 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-8b2adadd-e761-46f6-aa7f-83b542b0bf55 req-d6e0f244-1a05-42fc-994e-697e403ac522 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Updating instance_info_cache with network_info: [{"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": null, "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:09:03.374044 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Deleted allocations for instance 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa Jan 26 19:09:03.847217 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-8b2adadd-e761-46f6-aa7f-83b542b0bf55 req-d6e0f244-1a05-42fc-994e-697e403ac522 service nova] Releasing lock "refresh_cache-86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:09:03.879812 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:04.129657 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:09:04.633848 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:09:05.137996 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.175s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:05.138550 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:09:05.140546 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.261s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:05.270536 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:09:05.645241 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:09:05.645448 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:09:05.645744 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:05.646063 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:05.817059 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:09:05.847203 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" by "nova.compute.manager.ComputeManager.unshelve_instance..do_unshelve_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:05.883396 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12364a81a9ea43658a098cdfdb50e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fd2a7189d04227bf250a5dcfbc5d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:09:06.160420 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:09:06.323861 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.183s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:06.345293 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Successfully created port: 29c6aa90-9764-405c-9fa5-61eeda5345dd {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:09:06.665166 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:09:06.834576 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-db8359b1-57bf-45cf-a849-4485fe0a1b23 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" "released" by "nova.compute.manager.ComputeManager.shelve_instance..do_shelve_instance" :: held 15.432s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:06.836248 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" acquired by "nova.compute.manager.ComputeManager.unshelve_instance..do_unshelve_instance" :: waited 0.989s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:06.836601 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Unshelving Jan 26 19:09:07.164891 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:07.629815 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Successfully updated port: 29c6aa90-9764-405c-9fa5-61eeda5345dd {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:09:07.678210 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-54557a12-7a5f-45b4-978d-5d3cd669b3ac req-295d690e-ab25-4e50-bacc-5f3bc5d9d9f6 service nova] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Received event network-changed-29c6aa90-9764-405c-9fa5-61eeda5345dd {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:09:07.678353 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-54557a12-7a5f-45b4-978d-5d3cd669b3ac req-295d690e-ab25-4e50-bacc-5f3bc5d9d9f6 service nova] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Refreshing instance network info cache due to event network-changed-29c6aa90-9764-405c-9fa5-61eeda5345dd. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:09:07.678520 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-54557a12-7a5f-45b4-978d-5d3cd669b3ac req-295d690e-ab25-4e50-bacc-5f3bc5d9d9f6 service nova] Acquiring lock "refresh_cache-4893c817-2ec1-4ac2-b000-fe29d896fcaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:09:07.678659 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-54557a12-7a5f-45b4-978d-5d3cd669b3ac req-295d690e-ab25-4e50-bacc-5f3bc5d9d9f6 service nova] Acquired lock "refresh_cache-4893c817-2ec1-4ac2-b000-fe29d896fcaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:09:07.678809 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-54557a12-7a5f-45b4-978d-5d3cd669b3ac req-295d690e-ab25-4e50-bacc-5f3bc5d9d9f6 service nova] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Refreshing network info cache for port 29c6aa90-9764-405c-9fa5-61eeda5345dd {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:09:07.692959 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:09:07.693725 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:09:07.693995 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Creating image(s) Jan 26 19:09:07.694359 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "/opt/stack/data/nova/instances/4893c817-2ec1-4ac2-b000-fe29d896fcaa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:07.694534 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "/opt/stack/data/nova/instances/4893c817-2ec1-4ac2-b000-fe29d896fcaa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:07.695080 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "/opt/stack/data/nova/instances/4893c817-2ec1-4ac2-b000-fe29d896fcaa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:07.695510 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:09:07.698722 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:09:07.700227 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:07.761008 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:07.793898 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.093s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:07.794452 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:07.795165 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:07.795716 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:09:07.803170 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:09:07.803759 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:07.890154 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:07.890475 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:07.894549 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.087s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:07.894549 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/4893c817-2ec1-4ac2-b000-fe29d896fcaa/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:07.904566 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'pci_requests' on Instance uuid 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:09:07.933725 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/4893c817-2ec1-4ac2-b000-fe29d896fcaa/disk 1073741824" returned: 0 in 0.042s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:07.934035 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.139s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:07.934300 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:08.014538 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.080s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:08.015209 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4893c817-2ec1-4ac2-b000-fe29d896fcaa/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:09:08.015695 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4893c817-2ec1-4ac2-b000-fe29d896fcaa/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:08.105646 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4893c817-2ec1-4ac2-b000-fe29d896fcaa/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:08.106573 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Cannot resize image /opt/stack/data/nova/instances/4893c817-2ec1-4ac2-b000-fe29d896fcaa/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:09:08.107437 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:09:08.107972 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Ensure instance console log exists: /opt/stack/data/nova/instances/4893c817-2ec1-4ac2-b000-fe29d896fcaa/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:09:08.108685 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:08.109336 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:08.109877 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:08.134360 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "refresh_cache-4893c817-2ec1-4ac2-b000-fe29d896fcaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:09:08.180637 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-54557a12-7a5f-45b4-978d-5d3cd669b3ac req-295d690e-ab25-4e50-bacc-5f3bc5d9d9f6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:08.245790 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-54557a12-7a5f-45b4-978d-5d3cd669b3ac req-295d690e-ab25-4e50-bacc-5f3bc5d9d9f6 service nova] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:09:08.396509 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-54557a12-7a5f-45b4-978d-5d3cd669b3ac req-295d690e-ab25-4e50-bacc-5f3bc5d9d9f6 service nova] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:09:08.412253 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'numa_topology' on Instance uuid 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:09:08.534598 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:09:08.534688 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] VM Stopped (Lifecycle Event) Jan 26 19:09:08.899490 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-54557a12-7a5f-45b4-978d-5d3cd669b3ac req-295d690e-ab25-4e50-bacc-5f3bc5d9d9f6 service nova] Releasing lock "refresh_cache-4893c817-2ec1-4ac2-b000-fe29d896fcaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:09:08.900213 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquired lock "refresh_cache-4893c817-2ec1-4ac2-b000-fe29d896fcaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:09:08.900487 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:09:08.915516 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:09:08.915811 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Claim successful on node np0005596550.novalocal Jan 26 19:09:09.038998 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6623a649-757b-4c75-a2cd-cdb34ac5a5a6 None None] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:09:09.504978 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:09:09.624351 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:09.786490 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Updating instance_info_cache with network_info: [{"id": "29c6aa90-9764-405c-9fa5-61eeda5345dd", "address": "fa:16:3e:96:e4:da", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c6aa90-97", "ovs_interfaceid": "29c6aa90-9764-405c-9fa5-61eeda5345dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:09:10.050098 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:09:10.050234 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] VM Stopped (Lifecycle Event) Jan 26 19:09:10.139360 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:09:10.289448 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Releasing lock "refresh_cache-4893c817-2ec1-4ac2-b000-fe29d896fcaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:09:10.290053 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Instance network_info: |[{"id": "29c6aa90-9764-405c-9fa5-61eeda5345dd", "address": "fa:16:3e:96:e4:da", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c6aa90-97", "ovs_interfaceid": "29c6aa90-9764-405c-9fa5-61eeda5345dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:09:10.294674 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Start _get_guest_xml network_info=[{"id": "29c6aa90-9764-405c-9fa5-61eeda5345dd", "address": "fa:16:3e:96:e4:da", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c6aa90-97", "ovs_interfaceid": "29c6aa90-9764-405c-9fa5-61eeda5345dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:09:10.299241 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:09:10.301602 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServersTestJSON-server-877860801', uuid='4893c817-2ec1-4ac2-b000-fe29d896fcaa'), owner=OwnerMeta(userid='12364a81a9ea43658a098cdfdb50e3e3', username='tempest-ServersTestJSON-1441848345-project-member', projectid='06fd2a7189d04227bf250a5dcfbc5d96', projectname='tempest-ServersTestJSON-1441848345'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "29c6aa90-9764-405c-9fa5-61eeda5345dd", "address": "fa:16:3e:96:e4:da", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c6aa90-97", "ovs_interfaceid": "29c6aa90-9764-405c-9fa5-61eeda5345dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472550.3007069) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:09:10.303337 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:09:10.303866 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:09:10.304688 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:09:10.305188 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:09:10.306161 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:09:10.306531 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:09:10.306742 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:09:10.306893 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:09:10.307101 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:09:10.307247 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:09:10.307400 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:09:10.307673 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:09:10.307883 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:09:10.308047 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:09:10.308201 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:09:10.308369 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:09:10.311777 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:09:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersTestJSON-server-877860801',display_name='tempest-ServersTestJSON-server-877860801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstestjson-server-877860801',id=79,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5MQyqz67i4sXC835ieaWPOaMjUOGC9OrrvtXNmrgc3TnPvtabiYs7Pp6tXEltOr7TDNuJDuycMV8Y2v0UDbaq93w1hZBm/KVWsM4+0XMij93fOsuKfcsG0AzeFAPGCLg==',key_name='tempest-key-883289117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06fd2a7189d04227bf250a5dcfbc5d96',ramdisk_id='',reservation_id='r-5mf00sxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersTestJSON-1441848345',owner_user_name='tempest-ServersTestJSON-1441848345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:09:06Z,user_data=None,user_id='12364a81a9ea43658a098cdfdb50e3e3',uuid=4893c817-2ec1-4ac2-b000-fe29d896fcaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29c6aa90-9764-405c-9fa5-61eeda5345dd", "address": "fa:16:3e:96:e4:da", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c6aa90-97", "ovs_interfaceid": "29c6aa90-9764-405c-9fa5-61eeda5345dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:09:10.311973 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converting VIF {"id": "29c6aa90-9764-405c-9fa5-61eeda5345dd", "address": "fa:16:3e:96:e4:da", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c6aa90-97", "ovs_interfaceid": "29c6aa90-9764-405c-9fa5-61eeda5345dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:09:10.312591 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:e4:da,bridge_name='br-int',has_traffic_filtering=True,id=29c6aa90-9764-405c-9fa5-61eeda5345dd,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c6aa90-97') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:09:10.313177 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lazy-loading 'pci_devices' on Instance uuid 4893c817-2ec1-4ac2-b000-fe29d896fcaa {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:09:10.557447 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bd88fa44-a22e-49c9-906e-0f134c488070 None None] [instance: ddd5e451-9ac4-4b72-920e-20277da4eb44] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:09:10.643267 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] End _get_guest_xml xml= Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: 4893c817-2ec1-4ac2-b000-fe29d896fcaa Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: instance-0000004f Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: tempest-ServersTestJSON-server-877860801 Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:09:10 Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: tempest-ServersTestJSON-1441848345-project-member Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: tempest-ServersTestJSON-1441848345 Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: 4893c817-2ec1-4ac2-b000-fe29d896fcaa Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: 4893c817-2ec1-4ac2-b000-fe29d896fcaa Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:10.817523 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:09:10.819878 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Preparing to wait for external event network-vif-plugged-29c6aa90-9764-405c-9fa5-61eeda5345dd {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:09:10.819878 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:10.819878 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:10.819878 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:10.819878 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:09:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersTestJSON-server-877860801',display_name='tempest-ServersTestJSON-server-877860801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstestjson-server-877860801',id=79,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5MQyqz67i4sXC835ieaWPOaMjUOGC9OrrvtXNmrgc3TnPvtabiYs7Pp6tXEltOr7TDNuJDuycMV8Y2v0UDbaq93w1hZBm/KVWsM4+0XMij93fOsuKfcsG0AzeFAPGCLg==',key_name='tempest-key-883289117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06fd2a7189d04227bf250a5dcfbc5d96',ramdisk_id='',reservation_id='r-5mf00sxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersTestJSON-1441848345',owner_user_name='tempest-ServersTestJSON-1441848345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:09:06Z,user_data=None,user_id='12364a81a9ea43658a098cdfdb50e3e3',uuid=4893c817-2ec1-4ac2-b000-fe29d896fcaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29c6aa90-9764-405c-9fa5-61eeda5345dd", "address": "fa:16:3e:96:e4:da", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c6aa90-97", "ovs_interfaceid": "29c6aa90-9764-405c-9fa5-61eeda5345dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:09:10.820107 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converting VIF {"id": "29c6aa90-9764-405c-9fa5-61eeda5345dd", "address": "fa:16:3e:96:e4:da", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c6aa90-97", "ovs_interfaceid": "29c6aa90-9764-405c-9fa5-61eeda5345dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:09:10.820331 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:e4:da,bridge_name='br-int',has_traffic_filtering=True,id=29c6aa90-9764-405c-9fa5-61eeda5345dd,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c6aa90-97') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:09:10.820803 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:e4:da,bridge_name='br-int',has_traffic_filtering=True,id=29c6aa90-9764-405c-9fa5-61eeda5345dd,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c6aa90-97') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:09:10.821406 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:10.821902 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:10.822342 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:09:10.823431 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:10.823784 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72ad7220-c5ee-5e21-9863-f9f2040b14a2', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:10.826407 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:10.827861 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:09:10.831971 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:10.832208 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29c6aa90-97, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:10.832640 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29c6aa90-97, col_values=(('qos', UUID('da4daed1-848f-497a-b6f1-df9bebcfaeff')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:10.832887 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29c6aa90-97, col_values=(('external_ids', {'iface-id': '29c6aa90-9764-405c-9fa5-61eeda5345dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:e4:da', 'vm-uuid': '4893c817-2ec1-4ac2-b000-fe29d896fcaa'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:10.834663 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:10.836298 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:09:10.843359 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:10.843816 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:e4:da,bridge_name='br-int',has_traffic_filtering=True,id=29c6aa90-9764-405c-9fa5-61eeda5345dd,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c6aa90-97') Jan 26 19:09:10.896436 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:09:10.896683 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Cleaning up deleted instances {{(pid=189076) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11960}} Jan 26 19:09:11.147983 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.257s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:11.148357 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:11.205848 np0005596550.novalocal nova-compute[189076]: INFO nova.network.neutron [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Updating port 8de29cf0-d7bc-4d33-9f3c-a793ec1426ad with attributes {'binding:host_id': 'np0005596550.novalocal', 'device_owner': 'compute:nova'} Jan 26 19:09:11.400949 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] There are 0 instances to clean {{(pid=189076) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11969}} Jan 26 19:09:11.668440 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "refresh_cache-86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:09:11.669110 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquired lock "refresh_cache-86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:09:11.669110 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:09:11.702171 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-627f13db-bac5-493d-b9c4-ca8b3f08e457 req-25ec7ff3-6fe4-496c-9ba5-cb5b45cdd1f4 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Received event network-changed-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:09:11.702171 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-627f13db-bac5-493d-b9c4-ca8b3f08e457 req-25ec7ff3-6fe4-496c-9ba5-cb5b45cdd1f4 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Refreshing instance network info cache due to event network-changed-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:09:11.702171 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-627f13db-bac5-493d-b9c4-ca8b3f08e457 req-25ec7ff3-6fe4-496c-9ba5-cb5b45cdd1f4 service nova] Acquiring lock "refresh_cache-86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:09:12.163695 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:12.171070 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:12.365627 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:09:12.365817 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:09:12.365991 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] No VIF found with MAC fa:16:3e:96:e4:da, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:09:12.366812 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Using config drive Jan 26 19:09:12.402327 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:12.521544 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Updating instance_info_cache with network_info: [{"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:09:12.875052 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:12.895800 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:09:12.960599 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Creating config drive at /opt/stack/data/nova/instances/4893c817-2ec1-4ac2-b000-fe29d896fcaa/disk.config Jan 26 19:09:12.964529 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/4893c817-2ec1-4ac2-b000-fe29d896fcaa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpv9c4h1bj {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:13.024511 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Releasing lock "refresh_cache-86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:09:13.025860 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:09:13.026238 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Creating image(s) Jan 26 19:09:13.026722 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "/opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:13.026946 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "/opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:13.027511 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "/opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:13.027688 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'trusted_certs' on Instance uuid 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:09:13.029051 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-627f13db-bac5-493d-b9c4-ca8b3f08e457 req-25ec7ff3-6fe4-496c-9ba5-cb5b45cdd1f4 service nova] Acquired lock "refresh_cache-86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:09:13.029242 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-627f13db-bac5-493d-b9c4-ca8b3f08e457 req-25ec7ff3-6fe4-496c-9ba5-cb5b45cdd1f4 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Refreshing network info cache for port 8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:09:13.082298 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/4893c817-2ec1-4ac2-b000-fe29d896fcaa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpv9c4h1bj" returned: 0 in 0.118s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:13.174303 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:13.181638 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:13.205614 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:13.352792 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:13.356571 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:13.384873 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-9a51633d-9098-4f1c-bc37-c89063f8610c req-885181df-b60a-4ee3-99a7-af1c66b065bb service nova] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Received event network-vif-plugged-29c6aa90-9764-405c-9fa5-61eeda5345dd {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:09:13.385110 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-9a51633d-9098-4f1c-bc37-c89063f8610c req-885181df-b60a-4ee3-99a7-af1c66b065bb service nova] Acquiring lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:13.385351 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-9a51633d-9098-4f1c-bc37-c89063f8610c req-885181df-b60a-4ee3-99a7-af1c66b065bb service nova] Lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:13.386007 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-9a51633d-9098-4f1c-bc37-c89063f8610c req-885181df-b60a-4ee3-99a7-af1c66b065bb service nova] Lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:13.386228 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-9a51633d-9098-4f1c-bc37-c89063f8610c req-885181df-b60a-4ee3-99a7-af1c66b065bb service nova] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Processing event network-vif-plugged-29c6aa90-9764-405c-9fa5-61eeda5345dd {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:09:13.403802 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:09:13.403802 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:09:13.403802 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] VM Started (Lifecycle Event) Jan 26 19:09:13.406533 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:09:13.413408 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Instance spawned successfully. Jan 26 19:09:13.413948 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:09:13.531951 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Object Instance<86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:09:13.531951 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "fc9721f2078a4f7db01243ee62ffcdee01e56a7c" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:13.531951 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "fc9721f2078a4f7db01243ee62ffcdee01e56a7c" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:13.535064 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-627f13db-bac5-493d-b9c4-ca8b3f08e457 req-25ec7ff3-6fe4-496c-9ba5-cb5b45cdd1f4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:13.852711 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-627f13db-bac5-493d-b9c4-ca8b3f08e457 req-25ec7ff3-6fe4-496c-9ba5-cb5b45cdd1f4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:13.915214 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:09:14.423178 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:09:14.427093 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:09:14.427093 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:09:14.427093 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:09:14.427408 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:09:14.427622 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:09:14.427897 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:09:14.458979 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:09:14.461554 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:09:14.461859 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc9721f2078a4f7db01243ee62ffcdee01e56a7c.part --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:14.472904 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-627f13db-bac5-493d-b9c4-ca8b3f08e457 req-25ec7ff3-6fe4-496c-9ba5-cb5b45cdd1f4 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Updated VIF entry in instance network info cache for port 8de29cf0-d7bc-4d33-9f3c-a793ec1426ad. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:09:14.473441 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-627f13db-bac5-493d-b9c4-ca8b3f08e457 req-25ec7ff3-6fe4-496c-9ba5-cb5b45cdd1f4 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Updating instance_info_cache with network_info: [{"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:09:14.560854 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc9721f2078a4f7db01243ee62ffcdee01e56a7c.part --force-share --output=json" returned: 0 in 0.099s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:14.561259 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.images [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] ef1d2273-8c79-45fe-b933-a915d377657a was qcow2, converting to raw {{(pid=189076) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jan 26 19:09:14.562194 np0005596550.novalocal nova-compute[189076]: DEBUG nova.privsep.utils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=189076) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jan 26 19:09:14.562521 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fc9721f2078a4f7db01243ee62ffcdee01e56a7c.part /opt/stack/data/nova/instances/_base/fc9721f2078a4f7db01243ee62ffcdee01e56a7c.converted {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:14.875478 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fc9721f2078a4f7db01243ee62ffcdee01e56a7c.part /opt/stack/data/nova/instances/_base/fc9721f2078a4f7db01243ee62ffcdee01e56a7c.converted" returned: 0 in 0.313s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:14.883244 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc9721f2078a4f7db01243ee62ffcdee01e56a7c.converted --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:14.927227 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:09:14.927568 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:09:14.927854 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] VM Paused (Lifecycle Event) Jan 26 19:09:14.934213 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Took 7.24 seconds to spawn the instance on the hypervisor. Jan 26 19:09:14.934476 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:09:14.960535 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc9721f2078a4f7db01243ee62ffcdee01e56a7c.converted --force-share --output=json" returned: 0 in 0.077s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:14.960952 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "fc9721f2078a4f7db01243ee62ffcdee01e56a7c" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.429s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:14.961310 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:09:14.965903 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:09:14.967530 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc9721f2078a4f7db01243ee62ffcdee01e56a7c --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:14.978714 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-627f13db-bac5-493d-b9c4-ca8b3f08e457 req-25ec7ff3-6fe4-496c-9ba5-cb5b45cdd1f4 service nova] Releasing lock "refresh_cache-86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:09:15.051645 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc9721f2078a4f7db01243ee62ffcdee01e56a7c --force-share --output=json" returned: 0 in 0.084s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:15.052047 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "fc9721f2078a4f7db01243ee62ffcdee01e56a7c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:15.052431 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "fc9721f2078a4f7db01243ee62ffcdee01e56a7c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:15.052786 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:09:15.056029 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:09:15.056441 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc9721f2078a4f7db01243ee62ffcdee01e56a7c --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:15.127850 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc9721f2078a4f7db01243ee62ffcdee01e56a7c --force-share --output=json" returned: 0 in 0.071s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:15.128178 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc9721f2078a4f7db01243ee62ffcdee01e56a7c,backing_fmt=raw /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:15.163340 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc9721f2078a4f7db01243ee62ffcdee01e56a7c,backing_fmt=raw /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk 1073741824" returned: 0 in 0.035s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:15.163520 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "fc9721f2078a4f7db01243ee62ffcdee01e56a7c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.111s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:15.163806 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc9721f2078a4f7db01243ee62ffcdee01e56a7c --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:15.233899 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc9721f2078a4f7db01243ee62ffcdee01e56a7c --force-share --output=json" returned: 0 in 0.070s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:15.234427 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'migration_context' on Instance uuid 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:09:15.431015 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-35e0d3a1-4a51-4fbf-a110-d802e7e99e95 req-e171d223-de8c-4826-b69b-7e2009c28bf9 service nova] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Received event network-vif-plugged-29c6aa90-9764-405c-9fa5-61eeda5345dd {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:09:15.431272 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-35e0d3a1-4a51-4fbf-a110-d802e7e99e95 req-e171d223-de8c-4826-b69b-7e2009c28bf9 service nova] Acquiring lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:15.431506 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-35e0d3a1-4a51-4fbf-a110-d802e7e99e95 req-e171d223-de8c-4826-b69b-7e2009c28bf9 service nova] Lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:15.431691 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-35e0d3a1-4a51-4fbf-a110-d802e7e99e95 req-e171d223-de8c-4826-b69b-7e2009c28bf9 service nova] Lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:15.431894 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-35e0d3a1-4a51-4fbf-a110-d802e7e99e95 req-e171d223-de8c-4826-b69b-7e2009c28bf9 service nova] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] No waiting events found dispatching network-vif-plugged-29c6aa90-9764-405c-9fa5-61eeda5345dd {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:09:15.432088 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-35e0d3a1-4a51-4fbf-a110-d802e7e99e95 req-e171d223-de8c-4826-b69b-7e2009c28bf9 service nova] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Received unexpected event network-vif-plugged-29c6aa90-9764-405c-9fa5-61eeda5345dd for instance with vm_state active and task_state None. Jan 26 19:09:15.432994 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:09:15.437874 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:09:15.438057 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] VM Resumed (Lifecycle Event) Jan 26 19:09:15.448516 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Took 12.54 seconds to build instance. Jan 26 19:09:15.737889 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Object Instance<86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:09:15.738595 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Rebasing disk image. Jan 26 19:09:15.739057 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:15.834176 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:15.843677 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.104s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:15.844336 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa -F raw /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:15.941438 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:09:15.945638 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:09:15.950290 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bb1d8b01-21de-4eb9-896e-0de101bc5771 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.051s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:16.398539 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:09:16.509935 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:16.510393 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:16.510901 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:16.511297 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:16.511616 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:16.520015 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Terminating instance Jan 26 19:09:16.774113 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa -F raw /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk" returned: 0 in 0.930s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:16.774527 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:09:16.774716 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Ensure instance console log exists: /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:09:16.775128 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:16.775264 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:16.775407 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:16.777393 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Start _get_guest_xml network_info=[{"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b35158bf607630639108c24bdbb29c84',container_format='bare',created_at=2026-01-27T00:08:50Z,direct_url=,disk_format='qcow2',id=ef1d2273-8c79-45fe-b933-a915d377657a,min_disk=1,min_ram=0,name='tempest-ServerActionsTestOtherB-server-979228963-shelved',owner='8428b9d1e48c42f690612bf1e012ec42',properties=ImageMetaProps,protected=,size=53608448,status='active',tags=,updated_at=2026-01-27T00:08:58Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:09:16.781874 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:09:16.783032 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-979228963', uuid='86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa'), owner=OwnerMeta(userid='8369268788c24337ade1739d948c300a', username='tempest-ServerActionsTestOtherB-1262198412-project-member', projectid='8428b9d1e48c42f690612bf1e012ec42', projectname='tempest-ServerActionsTestOtherB-1262198412'), image=ImageMeta(id='ef1d2273-8c79-45fe-b933-a915d377657a', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472556.7826903) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:09:16.784542 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:09:16.784745 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:09:16.786306 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:09:16.786666 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:09:16.787591 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:09:16.787984 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b35158bf607630639108c24bdbb29c84',container_format='bare',created_at=2026-01-27T00:08:50Z,direct_url=,disk_format='qcow2',id=ef1d2273-8c79-45fe-b933-a915d377657a,min_disk=1,min_ram=0,name='tempest-ServerActionsTestOtherB-server-979228963-shelved',owner='8428b9d1e48c42f690612bf1e012ec42',properties=ImageMetaProps,protected=,size=53608448,status='active',tags=,updated_at=2026-01-27T00:08:58Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:09:16.788185 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:09:16.788336 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:09:16.788493 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:09:16.788602 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:09:16.788734 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:09:16.788915 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:09:16.789036 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:09:16.789170 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:09:16.789294 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:09:16.789460 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:09:16.789712 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'vcpu_model' on Instance uuid 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:09:16.903339 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:16.903551 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:16.903696 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:16.903852 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:09:17.031839 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:09:17.051631 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:17.056127 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:17.174683 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:17.183461 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:17.291959 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Object Instance<86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:09:17.295296 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-01-27T00:07:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-979228963',display_name='tempest-ServerActionsTestOtherB-server-979228963',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-979228963',id=74,image_ref='ef1d2273-8c79-45fe-b933-a915d377657a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-56259378',keypairs=,launch_index=0,launched_at=2026-01-27T00:07:39Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-bfui779d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member',shelved_at='2026-01-27T00:08:58.859453',shelved_host='np0005596550.novalocal',shelved_image_id='ef1d2273-8c79-45fe-b933-a915d377657a'},tags=,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:09:17.295537 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:09:17.297654 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:03:06,bridge_name='br-int',has_traffic_filtering=True,id=8de29cf0-d7bc-4d33-9f3c-a793ec1426ad,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de29cf0-d7') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:09:17.299425 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'pci_devices' on Instance uuid 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:09:17.304726 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Instance destroyed successfully. Jan 26 19:09:17.305280 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lazy-loading 'resources' on Instance uuid 4893c817-2ec1-4ac2-b000-fe29d896fcaa {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:09:17.475409 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c8894c93-39d3-46f8-b092-ee1fe917b037 req-092da380-8f55-487e-a5a7-faf753e2ed69 service nova] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Received event network-vif-unplugged-29c6aa90-9764-405c-9fa5-61eeda5345dd {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:09:17.475564 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c8894c93-39d3-46f8-b092-ee1fe917b037 req-092da380-8f55-487e-a5a7-faf753e2ed69 service nova] Acquiring lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:17.475735 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c8894c93-39d3-46f8-b092-ee1fe917b037 req-092da380-8f55-487e-a5a7-faf753e2ed69 service nova] Lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:17.475892 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c8894c93-39d3-46f8-b092-ee1fe917b037 req-092da380-8f55-487e-a5a7-faf753e2ed69 service nova] Lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:17.476141 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c8894c93-39d3-46f8-b092-ee1fe917b037 req-092da380-8f55-487e-a5a7-faf753e2ed69 service nova] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] No waiting events found dispatching network-vif-unplugged-29c6aa90-9764-405c-9fa5-61eeda5345dd {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:09:17.476141 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c8894c93-39d3-46f8-b092-ee1fe917b037 req-092da380-8f55-487e-a5a7-faf753e2ed69 service nova] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Received event network-vif-unplugged-29c6aa90-9764-405c-9fa5-61eeda5345dd for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:09:17.476273 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c8894c93-39d3-46f8-b092-ee1fe917b037 req-092da380-8f55-487e-a5a7-faf753e2ed69 service nova] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Received event network-vif-unplugged-29c6aa90-9764-405c-9fa5-61eeda5345dd {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:09:17.476400 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c8894c93-39d3-46f8-b092-ee1fe917b037 req-092da380-8f55-487e-a5a7-faf753e2ed69 service nova] Acquiring lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:17.476563 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c8894c93-39d3-46f8-b092-ee1fe917b037 req-092da380-8f55-487e-a5a7-faf753e2ed69 service nova] Lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:17.476662 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c8894c93-39d3-46f8-b092-ee1fe917b037 req-092da380-8f55-487e-a5a7-faf753e2ed69 service nova] Lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:17.477020 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c8894c93-39d3-46f8-b092-ee1fe917b037 req-092da380-8f55-487e-a5a7-faf753e2ed69 service nova] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] No waiting events found dispatching network-vif-unplugged-29c6aa90-9764-405c-9fa5-61eeda5345dd {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:09:17.477174 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c8894c93-39d3-46f8-b092-ee1fe917b037 req-092da380-8f55-487e-a5a7-faf753e2ed69 service nova] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Received event network-vif-unplugged-29c6aa90-9764-405c-9fa5-61eeda5345dd for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:09:17.802022 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Object Instance<86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] End _get_guest_xml xml= Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: instance-0000004a Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-server-979228963 Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:09:16 Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: ide Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: pc Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-1262198412-project-member Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsTestOtherB-1262198412 Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:17.803023 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:09:17.805683 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Preparing to wait for external event network-vif-plugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:09:17.805683 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:17.805683 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:17.805683 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:17.805683 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-01-27T00:07:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-979228963',display_name='tempest-ServerActionsTestOtherB-server-979228963',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-979228963',id=74,image_ref='ef1d2273-8c79-45fe-b933-a915d377657a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-56259378',keypairs=,launch_index=0,launched_at=2026-01-27T00:07:39Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-bfui779d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member',shelved_at='2026-01-27T00:08:58.859453',shelved_host='np0005596550.novalocal',shelved_image_id='ef1d2273-8c79-45fe-b933-a915d377657a'},tags=,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:09:17.806111 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:09:17.806111 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:03:06,bridge_name='br-int',has_traffic_filtering=True,id=8de29cf0-d7bc-4d33-9f3c-a793ec1426ad,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de29cf0-d7') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:09:17.806111 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:03:06,bridge_name='br-int',has_traffic_filtering=True,id=8de29cf0-d7bc-4d33-9f3c-a793ec1426ad,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de29cf0-d7') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:09:17.806111 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:17.806111 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:17.806111 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:09:17.806796 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:17.807459 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:09:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServersTestJSON-server-877860801',display_name='tempest-ServersTestJSON-server-877860801',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstestjson-server-877860801',id=79,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5MQyqz67i4sXC835ieaWPOaMjUOGC9OrrvtXNmrgc3TnPvtabiYs7Pp6tXEltOr7TDNuJDuycMV8Y2v0UDbaq93w1hZBm/KVWsM4+0XMij93fOsuKfcsG0AzeFAPGCLg==',key_name='tempest-key-883289117',keypairs=,launch_index=0,launched_at=2026-01-27T00:09:14Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='06fd2a7189d04227bf250a5dcfbc5d96',ramdisk_id='',reservation_id='r-5mf00sxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersTestJSON-1441848345',owner_user_name='tempest-ServersTestJSON-1441848345-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:09:14Z,user_data=None,user_id='12364a81a9ea43658a098cdfdb50e3e3',uuid=4893c817-2ec1-4ac2-b000-fe29d896fcaa,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29c6aa90-9764-405c-9fa5-61eeda5345dd", "address": "fa:16:3e:96:e4:da", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c6aa90-97", "ovs_interfaceid": "29c6aa90-9764-405c-9fa5-61eeda5345dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:09:17.807658 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converting VIF {"id": "29c6aa90-9764-405c-9fa5-61eeda5345dd", "address": "fa:16:3e:96:e4:da", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c6aa90-97", "ovs_interfaceid": "29c6aa90-9764-405c-9fa5-61eeda5345dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:09:17.808088 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:e4:da,bridge_name='br-int',has_traffic_filtering=True,id=29c6aa90-9764-405c-9fa5-61eeda5345dd,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c6aa90-97') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:09:17.808352 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:e4:da,bridge_name='br-int',has_traffic_filtering=True,id=29c6aa90-9764-405c-9fa5-61eeda5345dd,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c6aa90-97') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:09:17.809595 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f896bf4-3dba-5fd9-bda2-81bb98738b88', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:17.810846 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:17.812801 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:09:17.818867 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:17.819659 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:17.819880 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29c6aa90-97, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:17.821605 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:17.823589 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:09:17.824408 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:17.824658 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8de29cf0-d7, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:17.824962 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8de29cf0-d7, col_values=(('qos', UUID('6d7083c0-8a71-40c1-9dbe-07f2cc79c805')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:17.825220 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8de29cf0-d7, col_values=(('external_ids', {'iface-id': '8de29cf0-d7bc-4d33-9f3c-a793ec1426ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:03:06', 'vm-uuid': '86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:17.826735 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:17.830808 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:09:17.833611 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:17.834303 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:03:06,bridge_name='br-int',has_traffic_filtering=True,id=8de29cf0-d7bc-4d33-9f3c-a793ec1426ad,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de29cf0-d7') Jan 26 19:09:17.835042 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:17.835295 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da4daed1-848f-497a-b6f1-df9bebcfaeff) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:17.836140 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:17.837921 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:09:17.841483 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:17.844973 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:e4:da,bridge_name='br-int',has_traffic_filtering=True,id=29c6aa90-9764-405c-9fa5-61eeda5345dd,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c6aa90-97') Jan 26 19:09:17.845265 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Deleting instance files /opt/stack/data/nova/instances/4893c817-2ec1-4ac2-b000-fe29d896fcaa_del Jan 26 19:09:17.845663 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Deletion of /opt/stack/data/nova/instances/4893c817-2ec1-4ac2-b000-fe29d896fcaa_del complete Jan 26 19:09:17.933624 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000004f, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/4893c817-2ec1-4ac2-b000-fe29d896fcaa/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/4893c817-2ec1-4ac2-b000-fe29d896fcaa/disk Jan 26 19:09:17.939123 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d204b32-9530-4994-9cf3-be570ab5f3fc/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:18.008912 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:18.024317 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d204b32-9530-4994-9cf3-be570ab5f3fc/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:18.024757 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d204b32-9530-4994-9cf3-be570ab5f3fc/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:18.121138 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d204b32-9530-4994-9cf3-be570ab5f3fc/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:18.125531 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:18.199658 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk --force-share --output=json" returned: 0 in 0.074s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:18.200303 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:18.269244 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d/disk --force-share --output=json" returned: 0 in 0.069s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:18.355631 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Took 1.32 seconds to destroy the instance on the hypervisor. Jan 26 19:09:18.356006 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:09:18.356244 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:09:18.356374 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:09:18.356728 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:18.406587 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:09:18.407500 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:18.423158 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.015s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:18.423472 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=7460MB free_disk=373.14408111572266GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:09:18.423605 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:18.423851 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:18.511456 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:19.306116 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:09:19.354224 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:09:19.354531 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:09:19.354837 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] No VIF found with MAC fa:16:3e:3b:03:06, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:09:19.355776 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Using config drive Jan 26 19:09:19.518693 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-55d5f95f-9654-42ee-a032-7b80cd1e7a4c req-6f3bd4ec-92e5-4034-b739-5a58b697cfa8 service nova] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Received event network-vif-deleted-29c6aa90-9764-405c-9fa5-61eeda5345dd {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:09:19.662671 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance d0ddb554-76ed-49a6-a02b-042680eb310d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:09:19.662671 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 9d204b32-9530-4994-9cf3-be570ab5f3fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:09:19.662671 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 4893c817-2ec1-4ac2-b000-fe29d896fcaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:09:19.662671 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:09:19.662671 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 4 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:09:19.662671 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=1280MB phys_disk=399GB used_disk=4GB total_vcpus=8 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:09:18 up 37 min, 13 users, load average: 7.02, 5.57, 4.14\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '2', 'num_os_type_None': '4', 'num_proj_8428b9d1e48c42f690612bf1e012ec42': '2', 'io_workload': '0', 'num_vm_shelved_offloaded': '1', 'num_task_spawning': '1', 'num_proj_06fd2a7189d04227bf250a5dcfbc5d96': '2', 'num_task_deleting': '1'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:09:19.795594 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:09:19.813200 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Took 1.46 seconds to deallocate network for instance. Jan 26 19:09:19.861509 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'ec2_ids' on Instance uuid 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:09:20.300888 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:09:20.322696 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:20.374561 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Object Instance<86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:09:20.374950 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'keypairs' on Instance uuid 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:09:20.811318 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:09:20.811573 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.388s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:20.811696 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.489s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:20.881063 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Object Instance<86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:09:20.883681 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:20.991377 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Creating config drive at /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk.config Jan 26 19:09:20.995955 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp40pedba7 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:21.008586 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:09:21.115015 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp40pedba7" returned: 0 in 0.121s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:21.211955 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:21.219111 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:21.309456 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:09:21.309732 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:09:21.309958 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:09:21.344329 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:21.345486 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:21.375203 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:09:21.375446 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] VM Started (Lifecycle Event) Jan 26 19:09:21.513388 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:09:21.569182 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-90d8b5f7-acd9-42aa-9450-eca05cb2aa40 req-66f4569f-47f3-4c23-af58-31744cf9577b service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Received event network-vif-plugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:09:21.569362 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-90d8b5f7-acd9-42aa-9450-eca05cb2aa40 req-66f4569f-47f3-4c23-af58-31744cf9577b service nova] Acquiring lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:21.569558 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-90d8b5f7-acd9-42aa-9450-eca05cb2aa40 req-66f4569f-47f3-4c23-af58-31744cf9577b service nova] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:21.569710 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-90d8b5f7-acd9-42aa-9450-eca05cb2aa40 req-66f4569f-47f3-4c23-af58-31744cf9577b service nova] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:21.569898 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-90d8b5f7-acd9-42aa-9450-eca05cb2aa40 req-66f4569f-47f3-4c23-af58-31744cf9577b service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Processing event network-vif-plugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:09:21.570061 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-90d8b5f7-acd9-42aa-9450-eca05cb2aa40 req-66f4569f-47f3-4c23-af58-31744cf9577b service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Received event network-vif-plugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:09:21.570206 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-90d8b5f7-acd9-42aa-9450-eca05cb2aa40 req-66f4569f-47f3-4c23-af58-31744cf9577b service nova] Acquiring lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:21.570368 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-90d8b5f7-acd9-42aa-9450-eca05cb2aa40 req-66f4569f-47f3-4c23-af58-31744cf9577b service nova] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:21.570559 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-90d8b5f7-acd9-42aa-9450-eca05cb2aa40 req-66f4569f-47f3-4c23-af58-31744cf9577b service nova] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:21.570687 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-90d8b5f7-acd9-42aa-9450-eca05cb2aa40 req-66f4569f-47f3-4c23-af58-31744cf9577b service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] No waiting events found dispatching network-vif-plugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:09:21.570841 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-90d8b5f7-acd9-42aa-9450-eca05cb2aa40 req-66f4569f-47f3-4c23-af58-31744cf9577b service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Received unexpected event network-vif-plugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad for instance with vm_state shelved_offloaded and task_state spawning. Jan 26 19:09:21.571377 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:09:21.581784 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:09:21.584689 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Instance spawned successfully. Jan 26 19:09:21.882633 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:09:21.886200 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:09:21.895621 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:09:22.017799 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.206s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:22.113237 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:09:22.118069 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Deleted allocations for instance 4893c817-2ec1-4ac2-b000-fe29d896fcaa Jan 26 19:09:22.169497 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:22.389244 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:09:22.389643 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:09:22.389643 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] VM Paused (Lifecycle Event) Jan 26 19:09:22.637028 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-d740c27e-562f-4450-9c56-55e470b6abd4 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" "released" by "nova.compute.manager.ComputeManager.unshelve_instance..do_unshelve_instance" :: held 15.799s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:22.837084 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:22.895399 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:09:22.902067 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:09:22.902283 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] VM Resumed (Lifecycle Event) Jan 26 19:09:23.138199 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44f0c821-248c-4839-9798-8858b7a5b4c4 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "4893c817-2ec1-4ac2-b000-fe29d896fcaa" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.628s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:23.410709 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:09:23.418552 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:09:23.892408 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:09:23.895000 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:09:23.895211 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:09:23.895395 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:09:24.549815 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:24.550411 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:24.550411 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:24.550509 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:24.550690 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:24.555410 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Terminating instance Jan 26 19:09:24.618902 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "459cac8e-7df6-4a91-940f-fea48ca87f18" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:24.619083 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "459cac8e-7df6-4a91-940f-fea48ca87f18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:25.059677 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:09:25.098848 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:25.105526 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:25.121295 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:09:25.262628 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:25.270223 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:25.353689 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Instance destroyed successfully. Jan 26 19:09:25.354235 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'resources' on Instance uuid 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:09:25.688547 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:25.688994 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:25.693949 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:09:25.694283 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Claim successful on node np0005596550.novalocal Jan 26 19:09:25.859485 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-01-27T00:07:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-979228963',display_name='tempest-ServerActionsTestOtherB-server-979228963',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-979228963',id=74,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK72/fZgFXc8Nm23qFp5bqxu5uQWjdqvi6tf0S8eHH5LAOejrjAG2pg3k7mvst6GtMR5cAEv++XPpoBWMRpc6kXyw3lb+Uukjxykolyr/SPF2WcEU8zRsEYayUYxi/WyQ==',key_name='tempest-keypair-56259378',keypairs=,launch_index=0,launched_at=2026-01-27T00:09:22Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-bfui779d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:09:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8369268788c24337ade1739d948c300a',uuid=86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:09:25.859743 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "address": "fa:16:3e:3b:03:06", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de29cf0-d7", "ovs_interfaceid": "8de29cf0-d7bc-4d33-9f3c-a793ec1426ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:09:25.865289 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:03:06,bridge_name='br-int',has_traffic_filtering=True,id=8de29cf0-d7bc-4d33-9f3c-a793ec1426ad,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de29cf0-d7') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:09:25.865619 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:03:06,bridge_name='br-int',has_traffic_filtering=True,id=8de29cf0-d7bc-4d33-9f3c-a793ec1426ad,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de29cf0-d7') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:09:25.869484 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-674b6cd3-68a7-4df4-92f3-b000449cf706 req-bd67809c-07bd-4c66-b506-9b6ca9b4391b service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Received event network-vif-unplugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:09:25.871145 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-674b6cd3-68a7-4df4-92f3-b000449cf706 req-bd67809c-07bd-4c66-b506-9b6ca9b4391b service nova] Acquiring lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:25.871560 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-674b6cd3-68a7-4df4-92f3-b000449cf706 req-bd67809c-07bd-4c66-b506-9b6ca9b4391b service nova] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:25.871797 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-674b6cd3-68a7-4df4-92f3-b000449cf706 req-bd67809c-07bd-4c66-b506-9b6ca9b4391b service nova] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:25.871934 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-674b6cd3-68a7-4df4-92f3-b000449cf706 req-bd67809c-07bd-4c66-b506-9b6ca9b4391b service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] No waiting events found dispatching network-vif-unplugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:09:25.872134 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-674b6cd3-68a7-4df4-92f3-b000449cf706 req-bd67809c-07bd-4c66-b506-9b6ca9b4391b service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Received event network-vif-unplugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:09:25.873470 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-674b6cd3-68a7-4df4-92f3-b000449cf706 req-bd67809c-07bd-4c66-b506-9b6ca9b4391b service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Received event network-vif-unplugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:09:25.873602 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-674b6cd3-68a7-4df4-92f3-b000449cf706 req-bd67809c-07bd-4c66-b506-9b6ca9b4391b service nova] Acquiring lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:25.873809 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-674b6cd3-68a7-4df4-92f3-b000449cf706 req-bd67809c-07bd-4c66-b506-9b6ca9b4391b service nova] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:25.874018 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-674b6cd3-68a7-4df4-92f3-b000449cf706 req-bd67809c-07bd-4c66-b506-9b6ca9b4391b service nova] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:25.874188 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-674b6cd3-68a7-4df4-92f3-b000449cf706 req-bd67809c-07bd-4c66-b506-9b6ca9b4391b service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] No waiting events found dispatching network-vif-unplugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:09:25.874396 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-674b6cd3-68a7-4df4-92f3-b000449cf706 req-bd67809c-07bd-4c66-b506-9b6ca9b4391b service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Received event network-vif-unplugged-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:09:25.875646 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:25.876693 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8de29cf0-d7, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:25.882470 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:09:25.883166 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:25.883404 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d7083c0-8a71-40c1-9dbe-07f2cc79c805) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:25.884601 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:25.885649 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:25.889492 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:03:06,bridge_name='br-int',has_traffic_filtering=True,id=8de29cf0-d7bc-4d33-9f3c-a793ec1426ad,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de29cf0-d7') Jan 26 19:09:25.889988 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Deleting instance files /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa_del Jan 26 19:09:25.891826 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Deletion of /opt/stack/data/nova/instances/86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa_del complete Jan 26 19:09:25.895198 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:09:26.399940 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Took 1.34 seconds to destroy the instance on the hypervisor. Jan 26 19:09:26.400261 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:09:26.400466 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:09:26.400593 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:09:26.400882 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:26.452529 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:26.740549 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Refreshing inventories for resource provider f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}} Jan 26 19:09:26.778491 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Updating ProviderTree inventory for provider f627156c-932e-4a32-97b3-315a994a2ac9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}} Jan 26 19:09:26.778786 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Updating inventory in ProviderTree for provider f627156c-932e-4a32-97b3-315a994a2ac9 with inventory: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jan 26 19:09:26.817676 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Refreshing aggregate associations for resource provider f627156c-932e-4a32-97b3-315a994a2ac9, aggregates: None {{(pid=189076) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}} Jan 26 19:09:26.862212 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Refreshing trait associations for resource provider f627156c-932e-4a32-97b3-315a994a2ac9, traits: COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_ADDRESS_SPACE_EMULATED,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOUND_MODEL_SB16,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_IGB,HW_ARCH_X86_64,COMPUTE_ARCH_X86_64,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_SECURITY_STATELESS_FIRMWARE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOUND_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOUND_MODEL_AC97,COMPUTE_SOUND_MODEL_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ADDRESS_SPACE_PASSTHROUGH {{(pid=189076) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}} Jan 26 19:09:26.931832 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ca60a7ca-8180-4719-94e4-b56c6302649f req-8795169a-b516-4084-a670-60e0d77b98e7 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Received event network-vif-deleted-8de29cf0-d7bc-4d33-9f3c-a793ec1426ad {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:09:26.931832 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-ca60a7ca-8180-4719-94e4-b56c6302649f req-8795169a-b516-4084-a670-60e0d77b98e7 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Neutron deleted interface 8de29cf0-d7bc-4d33-9f3c-a793ec1426ad; detaching it from the instance and deleting it from the info cache Jan 26 19:09:26.931832 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-ca60a7ca-8180-4719-94e4-b56c6302649f req-8795169a-b516-4084-a670-60e0d77b98e7 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:09:27.032170 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:09:27.170254 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:27.385073 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:09:27.437120 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ca60a7ca-8180-4719-94e4-b56c6302649f req-8795169a-b516-4084-a670-60e0d77b98e7 service nova] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Detach interface failed, port_id=8de29cf0-d7bc-4d33-9f3c-a793ec1426ad, reason: Instance 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:09:27.537866 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:09:27.887583 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Took 1.49 seconds to deallocate network for instance. Jan 26 19:09:27.895219 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:09:27.895348 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Cleaning up deleted instances with incomplete migration {{(pid=189076) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11998}} Jan 26 19:09:28.046215 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.357s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:28.046757 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:09:28.395691 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:28.396085 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:28.557862 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:09:28.557862 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:09:28.557862 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:28.557862 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:28.593355 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:09:28.644621 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12364a81a9ea43658a098cdfdb50e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fd2a7189d04227bf250a5dcfbc5d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:09:29.076384 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Successfully created port: ff64ae6e-664d-41b4-9091-d338976ff780 {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:09:29.079214 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:09:29.097819 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:09:29.575233 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Successfully updated port: ff64ae6e-664d-41b4-9091-d338976ff780 {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:09:29.594729 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:09:29.601861 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.205s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:29.629314 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-00e81c5a-521d-4880-85f4-d98dfd0c914d req-3f437b4a-9681-4192-94e3-e52c5f3fd99f service nova] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Received event network-changed-ff64ae6e-664d-41b4-9091-d338976ff780 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:09:29.629645 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-00e81c5a-521d-4880-85f4-d98dfd0c914d req-3f437b4a-9681-4192-94e3-e52c5f3fd99f service nova] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Refreshing instance network info cache due to event network-changed-ff64ae6e-664d-41b4-9091-d338976ff780. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:09:29.630056 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-00e81c5a-521d-4880-85f4-d98dfd0c914d req-3f437b4a-9681-4192-94e3-e52c5f3fd99f service nova] Acquiring lock "refresh_cache-459cac8e-7df6-4a91-940f-fea48ca87f18" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:09:29.630323 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-00e81c5a-521d-4880-85f4-d98dfd0c914d req-3f437b4a-9681-4192-94e3-e52c5f3fd99f service nova] Acquired lock "refresh_cache-459cac8e-7df6-4a91-940f-fea48ca87f18" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:09:29.630678 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-00e81c5a-521d-4880-85f4-d98dfd0c914d req-3f437b4a-9681-4192-94e3-e52c5f3fd99f service nova] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Refreshing network info cache for port ff64ae6e-664d-41b4-9091-d338976ff780 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:09:29.681839 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Deleted allocations for instance 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa Jan 26 19:09:30.080189 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "refresh_cache-459cac8e-7df6-4a91-940f-fea48ca87f18" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:09:30.139478 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-00e81c5a-521d-4880-85f4-d98dfd0c914d req-3f437b4a-9681-4192-94e3-e52c5f3fd99f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:30.211644 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-00e81c5a-521d-4880-85f4-d98dfd0c914d req-3f437b4a-9681-4192-94e3-e52c5f3fd99f service nova] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:09:30.362325 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-00e81c5a-521d-4880-85f4-d98dfd0c914d req-3f437b4a-9681-4192-94e3-e52c5f3fd99f service nova] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:09:30.609816 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:09:30.611097 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:09:30.611559 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Creating image(s) Jan 26 19:09:30.613239 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "/opt/stack/data/nova/instances/459cac8e-7df6-4a91-940f-fea48ca87f18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:30.613672 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "/opt/stack/data/nova/instances/459cac8e-7df6-4a91-940f-fea48ca87f18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:30.614746 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "/opt/stack/data/nova/instances/459cac8e-7df6-4a91-940f-fea48ca87f18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:30.618791 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:09:30.621969 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:09:30.623862 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:30.697490 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c197261-6853-458a-a6f0-81f1637759ed tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.147s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:30.727798 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.102s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:30.727798 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:30.727798 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:30.727798 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:09:30.732229 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:09:30.732738 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:30.852542 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.115s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:30.853039 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/459cac8e-7df6-4a91-940f-fea48ca87f18/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:30.868534 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-00e81c5a-521d-4880-85f4-d98dfd0c914d req-3f437b4a-9681-4192-94e3-e52c5f3fd99f service nova] Releasing lock "refresh_cache-459cac8e-7df6-4a91-940f-fea48ca87f18" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:09:30.869570 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquired lock "refresh_cache-459cac8e-7df6-4a91-940f-fea48ca87f18" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:09:30.869996 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:09:30.883757 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:30.896509 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/459cac8e-7df6-4a91-940f-fea48ca87f18/disk 1073741824" returned: 0 in 0.043s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:30.896956 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.170s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:30.897335 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:30.971924 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.074s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:30.972143 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Checking if we can resize image /opt/stack/data/nova/instances/459cac8e-7df6-4a91-940f-fea48ca87f18/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:09:30.972413 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/459cac8e-7df6-4a91-940f-fea48ca87f18/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:31.045391 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/459cac8e-7df6-4a91-940f-fea48ca87f18/disk --force-share --output=json" returned: 0 in 0.073s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:31.045669 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Cannot resize image /opt/stack/data/nova/instances/459cac8e-7df6-4a91-940f-fea48ca87f18/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:09:31.047565 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:09:31.047565 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Ensure instance console log exists: /opt/stack/data/nova/instances/459cac8e-7df6-4a91-940f-fea48ca87f18/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:09:31.047565 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:31.047565 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:31.047565 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:31.426655 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:09:31.546548 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:31.648512 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Updating instance_info_cache with network_info: [{"id": "ff64ae6e-664d-41b4-9091-d338976ff780", "address": "fa:16:3e:75:d6:f4", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64ae6e-66", "ovs_interfaceid": "ff64ae6e-664d-41b4-9091-d338976ff780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:09:32.151780 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Releasing lock "refresh_cache-459cac8e-7df6-4a91-940f-fea48ca87f18" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:09:32.152355 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Instance network_info: |[{"id": "ff64ae6e-664d-41b4-9091-d338976ff780", "address": "fa:16:3e:75:d6:f4", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64ae6e-66", "ovs_interfaceid": "ff64ae6e-664d-41b4-9091-d338976ff780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:09:32.156396 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Start _get_guest_xml network_info=[{"id": "ff64ae6e-664d-41b4-9091-d338976ff780", "address": "fa:16:3e:75:d6:f4", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64ae6e-66", "ovs_interfaceid": "ff64ae6e-664d-41b4-9091-d338976ff780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:09:32.166160 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:09:32.168072 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServersTestJSON-server-580295323', uuid='459cac8e-7df6-4a91-940f-fea48ca87f18'), owner=OwnerMeta(userid='12364a81a9ea43658a098cdfdb50e3e3', username='tempest-ServersTestJSON-1441848345-project-member', projectid='06fd2a7189d04227bf250a5dcfbc5d96', projectname='tempest-ServersTestJSON-1441848345'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ff64ae6e-664d-41b4-9091-d338976ff780", "address": "fa:16:3e:75:d6:f4", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64ae6e-66", "ovs_interfaceid": "ff64ae6e-664d-41b4-9091-d338976ff780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472572.1672993) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:09:32.169977 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:09:32.170621 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:09:32.171185 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:32.176095 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:09:32.176581 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:09:32.179297 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:09:32.180087 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:09:32.180513 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:09:32.181048 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:09:32.181470 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:09:32.181860 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:09:32.182161 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:09:32.182728 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:09:32.183100 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:09:32.183479 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:09:32.183870 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:09:32.184211 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:09:32.190414 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:09:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersTestJSON-server-580295323',display_name='tempest-ServersTestJSON-server-580295323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstestjson-server-580295323',id=80,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06fd2a7189d04227bf250a5dcfbc5d96',ramdisk_id='',reservation_id='r-0t880jrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersTestJSON-1441848345',owner_user_name='tempest-ServersTestJSON-1441848345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:09:29Z,user_data=None,user_id='12364a81a9ea43658a098cdfdb50e3e3',uuid=459cac8e-7df6-4a91-940f-fea48ca87f18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff64ae6e-664d-41b4-9091-d338976ff780", "address": "fa:16:3e:75:d6:f4", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64ae6e-66", "ovs_interfaceid": "ff64ae6e-664d-41b4-9091-d338976ff780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:09:32.191191 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converting VIF {"id": "ff64ae6e-664d-41b4-9091-d338976ff780", "address": "fa:16:3e:75:d6:f4", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64ae6e-66", "ovs_interfaceid": "ff64ae6e-664d-41b4-9091-d338976ff780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:09:32.192399 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:d6:f4,bridge_name='br-int',has_traffic_filtering=True,id=ff64ae6e-664d-41b4-9091-d338976ff780,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64ae6e-66') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:09:32.193589 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lazy-loading 'pci_devices' on Instance uuid 459cac8e-7df6-4a91-940f-fea48ca87f18 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:09:32.290080 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:09:32.290160 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] VM Stopped (Lifecycle Event) Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] End _get_guest_xml xml= Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: 459cac8e-7df6-4a91-940f-fea48ca87f18 Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: instance-00000050 Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: tempest-ServersTestJSON-server-580295323 Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:09:32 Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: tempest-ServersTestJSON-1441848345-project-member Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: tempest-ServersTestJSON-1441848345 Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: 459cac8e-7df6-4a91-940f-fea48ca87f18 Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: 459cac8e-7df6-4a91-940f-fea48ca87f18 Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:32.698858 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:09:32.701064 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Preparing to wait for external event network-vif-plugged-ff64ae6e-664d-41b4-9091-d338976ff780 {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:09:32.701064 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "459cac8e-7df6-4a91-940f-fea48ca87f18-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:32.701064 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "459cac8e-7df6-4a91-940f-fea48ca87f18-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:32.701755 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "459cac8e-7df6-4a91-940f-fea48ca87f18-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:32.702794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:09:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersTestJSON-server-580295323',display_name='tempest-ServersTestJSON-server-580295323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstestjson-server-580295323',id=80,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06fd2a7189d04227bf250a5dcfbc5d96',ramdisk_id='',reservation_id='r-0t880jrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersTestJSON-1441848345',owner_user_name='tempest-ServersTestJSON-1441848345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:09:29Z,user_data=None,user_id='12364a81a9ea43658a098cdfdb50e3e3',uuid=459cac8e-7df6-4a91-940f-fea48ca87f18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff64ae6e-664d-41b4-9091-d338976ff780", "address": "fa:16:3e:75:d6:f4", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64ae6e-66", "ovs_interfaceid": "ff64ae6e-664d-41b4-9091-d338976ff780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:09:32.703289 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converting VIF {"id": "ff64ae6e-664d-41b4-9091-d338976ff780", "address": "fa:16:3e:75:d6:f4", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64ae6e-66", "ovs_interfaceid": "ff64ae6e-664d-41b4-9091-d338976ff780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:09:32.704315 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:d6:f4,bridge_name='br-int',has_traffic_filtering=True,id=ff64ae6e-664d-41b4-9091-d338976ff780,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64ae6e-66') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:09:32.704315 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:d6:f4,bridge_name='br-int',has_traffic_filtering=True,id=ff64ae6e-664d-41b4-9091-d338976ff780,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64ae6e-66') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:09:32.705245 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:32.706197 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:32.706599 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:09:32.707916 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:32.707916 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef0fce03-fb40-57ee-8f6b-581acb04d74f', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:32.709142 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:32.711219 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:09:32.714704 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:32.717955 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:32.718285 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff64ae6e-66, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:32.718789 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff64ae6e-66, col_values=(('qos', UUID('d8cc75d1-346d-4bc1-9b77-6dc5d99ee2d6')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:32.719080 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff64ae6e-66, col_values=(('external_ids', {'iface-id': 'ff64ae6e-664d-41b4-9091-d338976ff780', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:d6:f4', 'vm-uuid': '459cac8e-7df6-4a91-940f-fea48ca87f18'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:32.720524 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:32.723793 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:09:32.731485 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:32.733041 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:d6:f4,bridge_name='br-int',has_traffic_filtering=True,id=ff64ae6e-664d-41b4-9091-d338976ff780,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64ae6e-66') Jan 26 19:09:32.793421 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-004c4098-c0c1-47c8-aa31-2ef197fa23d7 None None] [instance: 4893c817-2ec1-4ac2-b000-fe29d896fcaa] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:09:34.234359 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "d0ddb554-76ed-49a6-a02b-042680eb310d" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:34.234822 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "d0ddb554-76ed-49a6-a02b-042680eb310d" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:34.235202 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "d0ddb554-76ed-49a6-a02b-042680eb310d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:34.235530 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "d0ddb554-76ed-49a6-a02b-042680eb310d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:34.235866 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "d0ddb554-76ed-49a6-a02b-042680eb310d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:34.240197 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Terminating instance Jan 26 19:09:34.258559 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:09:34.258941 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:09:34.259237 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] No VIF found with MAC fa:16:3e:75:d6:f4, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:09:34.261449 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Using config drive Jan 26 19:09:34.746292 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:09:34.769827 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:34.807941 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:34.817818 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:35.005904 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Creating config drive at /opt/stack/data/nova/instances/459cac8e-7df6-4a91-940f-fea48ca87f18/disk.config Jan 26 19:09:35.011386 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/459cac8e-7df6-4a91-940f-fea48ca87f18/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp_4bonum2 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:35.036327 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Instance destroyed successfully. Jan 26 19:09:35.037227 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lazy-loading 'resources' on Instance uuid d0ddb554-76ed-49a6-a02b-042680eb310d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:09:35.135862 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/459cac8e-7df6-4a91-940f-fea48ca87f18/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp_4bonum2" returned: 0 in 0.124s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:35.194669 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-1d52f382-c4eb-42d5-830a-47997fd8c30f req-6d89b8b0-6b46-4b48-a59f-6772b9cfd1c0 service nova] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Received event network-vif-unplugged-dcf15471-a9ae-4c77-9a75-1665544873d5 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:09:35.195112 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1d52f382-c4eb-42d5-830a-47997fd8c30f req-6d89b8b0-6b46-4b48-a59f-6772b9cfd1c0 service nova] Acquiring lock "d0ddb554-76ed-49a6-a02b-042680eb310d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:35.195523 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1d52f382-c4eb-42d5-830a-47997fd8c30f req-6d89b8b0-6b46-4b48-a59f-6772b9cfd1c0 service nova] Lock "d0ddb554-76ed-49a6-a02b-042680eb310d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:35.195900 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1d52f382-c4eb-42d5-830a-47997fd8c30f req-6d89b8b0-6b46-4b48-a59f-6772b9cfd1c0 service nova] Lock "d0ddb554-76ed-49a6-a02b-042680eb310d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:35.196247 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-1d52f382-c4eb-42d5-830a-47997fd8c30f req-6d89b8b0-6b46-4b48-a59f-6772b9cfd1c0 service nova] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] No waiting events found dispatching network-vif-unplugged-dcf15471-a9ae-4c77-9a75-1665544873d5 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:09:35.196585 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-1d52f382-c4eb-42d5-830a-47997fd8c30f req-6d89b8b0-6b46-4b48-a59f-6772b9cfd1c0 service nova] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Received event network-vif-unplugged-dcf15471-a9ae-4c77-9a75-1665544873d5 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:09:35.222812 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:35.233354 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:35.244601 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:35.359559 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:35.364357 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:35.390787 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:09:35.390971 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] VM Started (Lifecycle Event) Jan 26 19:09:35.544160 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1127513470',display_name='tempest-ServerActionsTestOtherB-server-1127513470',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionstestotherb-server-1127513470',id=64,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:04:23Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8428b9d1e48c42f690612bf1e012ec42',ramdisk_id='',reservation_id='r-yd3sg8h4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1262198412',owner_user_name='tempest-ServerActionsTestOtherB-1262198412-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:04:23Z,user_data=None,user_id='8369268788c24337ade1739d948c300a',uuid=d0ddb554-76ed-49a6-a02b-042680eb310d,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcf15471-a9ae-4c77-9a75-1665544873d5", "address": "fa:16:3e:5d:9e:bd", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf15471-a9", "ovs_interfaceid": "dcf15471-a9ae-4c77-9a75-1665544873d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:09:35.544406 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converting VIF {"id": "dcf15471-a9ae-4c77-9a75-1665544873d5", "address": "fa:16:3e:5d:9e:bd", "network": {"id": "c29d0389-610f-4818-bdf8-0c24fb35fc34", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-630226605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8428b9d1e48c42f690612bf1e012ec42", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf15471-a9", "ovs_interfaceid": "dcf15471-a9ae-4c77-9a75-1665544873d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:09:35.546464 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9e:bd,bridge_name='br-int',has_traffic_filtering=True,id=dcf15471-a9ae-4c77-9a75-1665544873d5,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcf15471-a9') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:09:35.546464 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9e:bd,bridge_name='br-int',has_traffic_filtering=True,id=dcf15471-a9ae-4c77-9a75-1665544873d5,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcf15471-a9') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:09:35.549181 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:35.549663 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcf15471-a9, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:35.552156 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:35.554634 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:35.555167 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:35.555505 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27c4fc7f-0f7b-4a37-886c-5b53bfcaaa09) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:35.557183 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:35.560077 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:35.563195 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9e:bd,bridge_name='br-int',has_traffic_filtering=True,id=dcf15471-a9ae-4c77-9a75-1665544873d5,network=Network(c29d0389-610f-4818-bdf8-0c24fb35fc34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcf15471-a9') Jan 26 19:09:35.564018 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Deleting instance files /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d_del Jan 26 19:09:35.565313 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Deletion of /opt/stack/data/nova/instances/d0ddb554-76ed-49a6-a02b-042680eb310d_del complete Jan 26 19:09:35.899116 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:09:35.902027 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:09:35.902233 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] VM Paused (Lifecycle Event) Jan 26 19:09:36.086087 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Took 1.34 seconds to destroy the instance on the hypervisor. Jan 26 19:09:36.086584 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:09:36.086964 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:09:36.087165 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:09:36.087661 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:36.170095 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:36.406406 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:09:36.417015 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:09:36.919383 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:09:36.921098 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:09:37.173711 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:37.245570 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-72a4b49d-f70e-4ecc-b0ed-cd659c1aaa2d req-a229d838-2307-4cd5-8079-60b10cd4fbca service nova] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Received event network-vif-unplugged-dcf15471-a9ae-4c77-9a75-1665544873d5 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:09:37.245756 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-72a4b49d-f70e-4ecc-b0ed-cd659c1aaa2d req-a229d838-2307-4cd5-8079-60b10cd4fbca service nova] Acquiring lock "d0ddb554-76ed-49a6-a02b-042680eb310d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:37.245903 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-72a4b49d-f70e-4ecc-b0ed-cd659c1aaa2d req-a229d838-2307-4cd5-8079-60b10cd4fbca service nova] Lock "d0ddb554-76ed-49a6-a02b-042680eb310d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:37.246038 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-72a4b49d-f70e-4ecc-b0ed-cd659c1aaa2d req-a229d838-2307-4cd5-8079-60b10cd4fbca service nova] Lock "d0ddb554-76ed-49a6-a02b-042680eb310d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:37.246230 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-72a4b49d-f70e-4ecc-b0ed-cd659c1aaa2d req-a229d838-2307-4cd5-8079-60b10cd4fbca service nova] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] No waiting events found dispatching network-vif-unplugged-dcf15471-a9ae-4c77-9a75-1665544873d5 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:09:37.246378 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-72a4b49d-f70e-4ecc-b0ed-cd659c1aaa2d req-a229d838-2307-4cd5-8079-60b10cd4fbca service nova] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Received event network-vif-unplugged-dcf15471-a9ae-4c77-9a75-1665544873d5 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:09:37.246480 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-72a4b49d-f70e-4ecc-b0ed-cd659c1aaa2d req-a229d838-2307-4cd5-8079-60b10cd4fbca service nova] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Received event network-vif-plugged-ff64ae6e-664d-41b4-9091-d338976ff780 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:09:37.246605 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-72a4b49d-f70e-4ecc-b0ed-cd659c1aaa2d req-a229d838-2307-4cd5-8079-60b10cd4fbca service nova] Acquiring lock "459cac8e-7df6-4a91-940f-fea48ca87f18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:37.246760 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-72a4b49d-f70e-4ecc-b0ed-cd659c1aaa2d req-a229d838-2307-4cd5-8079-60b10cd4fbca service nova] Lock "459cac8e-7df6-4a91-940f-fea48ca87f18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:37.246890 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-72a4b49d-f70e-4ecc-b0ed-cd659c1aaa2d req-a229d838-2307-4cd5-8079-60b10cd4fbca service nova] Lock "459cac8e-7df6-4a91-940f-fea48ca87f18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:37.247016 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-72a4b49d-f70e-4ecc-b0ed-cd659c1aaa2d req-a229d838-2307-4cd5-8079-60b10cd4fbca service nova] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Processing event network-vif-plugged-ff64ae6e-664d-41b4-9091-d338976ff780 {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:09:37.247159 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-72a4b49d-f70e-4ecc-b0ed-cd659c1aaa2d req-a229d838-2307-4cd5-8079-60b10cd4fbca service nova] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Received event network-vif-plugged-ff64ae6e-664d-41b4-9091-d338976ff780 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:09:37.247302 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-72a4b49d-f70e-4ecc-b0ed-cd659c1aaa2d req-a229d838-2307-4cd5-8079-60b10cd4fbca service nova] Acquiring lock "459cac8e-7df6-4a91-940f-fea48ca87f18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:37.247482 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-72a4b49d-f70e-4ecc-b0ed-cd659c1aaa2d req-a229d838-2307-4cd5-8079-60b10cd4fbca service nova] Lock "459cac8e-7df6-4a91-940f-fea48ca87f18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:37.248401 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-72a4b49d-f70e-4ecc-b0ed-cd659c1aaa2d req-a229d838-2307-4cd5-8079-60b10cd4fbca service nova] Lock "459cac8e-7df6-4a91-940f-fea48ca87f18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:37.248401 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-72a4b49d-f70e-4ecc-b0ed-cd659c1aaa2d req-a229d838-2307-4cd5-8079-60b10cd4fbca service nova] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] No waiting events found dispatching network-vif-plugged-ff64ae6e-664d-41b4-9091-d338976ff780 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:09:37.248401 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-72a4b49d-f70e-4ecc-b0ed-cd659c1aaa2d req-a229d838-2307-4cd5-8079-60b10cd4fbca service nova] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Received unexpected event network-vif-plugged-ff64ae6e-664d-41b4-9091-d338976ff780 for instance with vm_state building and task_state spawning. Jan 26 19:09:37.248401 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-72a4b49d-f70e-4ecc-b0ed-cd659c1aaa2d req-a229d838-2307-4cd5-8079-60b10cd4fbca service nova] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Received event network-vif-deleted-dcf15471-a9ae-4c77-9a75-1665544873d5 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:09:37.248564 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:09:37.253567 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:09:37.253722 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] VM Resumed (Lifecycle Event) Jan 26 19:09:37.260228 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:09:37.264747 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Instance spawned successfully. Jan 26 19:09:37.267089 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:09:37.422370 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Took 1.34 seconds to deallocate network for instance. Jan 26 19:09:37.762228 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:09:37.783867 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:09:37.810808 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:09:37.810808 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:09:37.810808 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:09:37.810808 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:09:37.810808 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:09:37.810808 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:09:37.931110 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:37.931110 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:38.102480 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:09:38.288815 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:09:38.318242 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Took 7.71 seconds to spawn the instance on the hypervisor. Jan 26 19:09:38.318498 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:09:38.607844 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:09:38.829280 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Took 13.20 seconds to build instance. Jan 26 19:09:39.114793 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.181s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:39.160366 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Deleted allocations for instance d0ddb554-76ed-49a6-a02b-042680eb310d Jan 26 19:09:39.332143 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bfa35b84-e476-410f-9d45-cb5d6723460f tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "459cac8e-7df6-4a91-940f-fea48ca87f18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.713s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:39.419884 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._sync_power_states {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:09:39.929791 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] While synchronizing instance power states, found 3 instances in the database and 2 instances on the hypervisor. Jan 26 19:09:39.929791 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Triggering sync for uuid d0ddb554-76ed-49a6-a02b-042680eb310d {{(pid=189076) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11071}} Jan 26 19:09:39.930380 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Triggering sync for uuid 9d204b32-9530-4994-9cf3-be570ab5f3fc {{(pid=189076) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11071}} Jan 26 19:09:39.931784 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Triggering sync for uuid 459cac8e-7df6-4a91-940f-fea48ca87f18 {{(pid=189076) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11071}} Jan 26 19:09:39.931784 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "d0ddb554-76ed-49a6-a02b-042680eb310d" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:39.931784 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "9d204b32-9530-4994-9cf3-be570ab5f3fc" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:39.931784 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:39.932343 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "459cac8e-7df6-4a91-940f-fea48ca87f18" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:39.932507 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "459cac8e-7df6-4a91-940f-fea48ca87f18" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:40.172480 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9a0977e1-67a8-4c4f-9d70-4e21dcf5f7e8 tempest-ServerActionsTestOtherB-1262198412 tempest-ServerActionsTestOtherB-1262198412-project-member] Lock "d0ddb554-76ed-49a6-a02b-042680eb310d" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 5.937s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:40.175517 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "d0ddb554-76ed-49a6-a02b-042680eb310d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.244s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:40.354602 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:09:40.354693 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] VM Stopped (Lifecycle Event) Jan 26 19:09:40.443813 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.512s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:40.446234 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "459cac8e-7df6-4a91-940f-fea48ca87f18" "released" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.514s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:40.557023 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:40.688120 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "d0ddb554-76ed-49a6-a02b-042680eb310d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.513s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:40.819207 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "b7bca13f-0122-4185-997c-70b18dc019f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:40.819419 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "b7bca13f-0122-4185-997c-70b18dc019f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:40.859632 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e4ee9991-0b2a-4b78-a433-99a2ff8c7d75 None None] [instance: 86e3aa43-a5b2-4af9-ac77-bf2dd10e5aaa] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:09:41.322326 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:09:41.866588 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:41.866806 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:41.870988 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:09:41.871138 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Claim successful on node np0005596550.novalocal Jan 26 19:09:42.721183 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:43.035030 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:09:43.538787 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:09:44.045739 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.179s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:44.046420 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:09:44.552667 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:09:44.552977 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:09:44.552977 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:44.553420 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:44.742353 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12364a81a9ea43658a098cdfdb50e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fd2a7189d04227bf250a5dcfbc5d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:09:45.056146 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:09:45.228666 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Successfully created port: c311d9a8-cb5a-4e63-8151-152e54f02400 {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:09:45.560169 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:09:45.604957 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:45.768511 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Successfully updated port: c311d9a8-cb5a-4e63-8151-152e54f02400 {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:09:45.805021 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3a749398-ab63-47f0-b9df-ac2f49a365bd req-56a8bc9a-bf9b-41ee-ae53-0e107638d664 service nova] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Received event network-changed-c311d9a8-cb5a-4e63-8151-152e54f02400 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:09:45.805177 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3a749398-ab63-47f0-b9df-ac2f49a365bd req-56a8bc9a-bf9b-41ee-ae53-0e107638d664 service nova] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Refreshing instance network info cache due to event network-changed-c311d9a8-cb5a-4e63-8151-152e54f02400. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:09:45.805349 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3a749398-ab63-47f0-b9df-ac2f49a365bd req-56a8bc9a-bf9b-41ee-ae53-0e107638d664 service nova] Acquiring lock "refresh_cache-b7bca13f-0122-4185-997c-70b18dc019f6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:09:45.805457 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3a749398-ab63-47f0-b9df-ac2f49a365bd req-56a8bc9a-bf9b-41ee-ae53-0e107638d664 service nova] Acquired lock "refresh_cache-b7bca13f-0122-4185-997c-70b18dc019f6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:09:45.805588 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-3a749398-ab63-47f0-b9df-ac2f49a365bd req-56a8bc9a-bf9b-41ee-ae53-0e107638d664 service nova] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Refreshing network info cache for port c311d9a8-cb5a-4e63-8151-152e54f02400 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:09:46.271936 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "refresh_cache-b7bca13f-0122-4185-997c-70b18dc019f6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:09:46.308294 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-3a749398-ab63-47f0-b9df-ac2f49a365bd req-56a8bc9a-bf9b-41ee-ae53-0e107638d664 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:46.366993 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-3a749398-ab63-47f0-b9df-ac2f49a365bd req-56a8bc9a-bf9b-41ee-ae53-0e107638d664 service nova] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:09:46.546543 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-3a749398-ab63-47f0-b9df-ac2f49a365bd req-56a8bc9a-bf9b-41ee-ae53-0e107638d664 service nova] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:09:46.617417 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:09:46.619291 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:09:46.619713 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Creating image(s) Jan 26 19:09:46.622650 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7bca13f-0122-4185-997c-70b18dc019f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:46.623005 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "/opt/stack/data/nova/instances/b7bca13f-0122-4185-997c-70b18dc019f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:46.624052 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "/opt/stack/data/nova/instances/b7bca13f-0122-4185-997c-70b18dc019f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:46.624994 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:09:46.628308 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:09:46.631057 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:46.712454 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.081s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:46.712842 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:46.713306 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:46.713661 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:09:46.721379 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:09:46.721697 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:46.806033 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.084s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:46.806359 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/b7bca13f-0122-4185-997c-70b18dc019f6/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:46.836843 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/b7bca13f-0122-4185-997c-70b18dc019f6/disk 1073741824" returned: 0 in 0.030s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:46.837257 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.124s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:46.837562 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:46.899525 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:46.904336 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.066s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:46.904963 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7bca13f-0122-4185-997c-70b18dc019f6/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:09:46.904963 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7bca13f-0122-4185-997c-70b18dc019f6/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:46.986272 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7bca13f-0122-4185-997c-70b18dc019f6/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:46.987493 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Cannot resize image /opt/stack/data/nova/instances/b7bca13f-0122-4185-997c-70b18dc019f6/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:09:46.988523 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:09:46.988777 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Ensure instance console log exists: /opt/stack/data/nova/instances/b7bca13f-0122-4185-997c-70b18dc019f6/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:09:46.989537 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:46.989537 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:46.989713 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:47.054545 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3a749398-ab63-47f0-b9df-ac2f49a365bd req-56a8bc9a-bf9b-41ee-ae53-0e107638d664 service nova] Releasing lock "refresh_cache-b7bca13f-0122-4185-997c-70b18dc019f6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:09:47.054545 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquired lock "refresh_cache-b7bca13f-0122-4185-997c-70b18dc019f6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:09:47.054545 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:09:47.176623 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:47.635451 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:09:47.946931 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:48.293297 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Updating instance_info_cache with network_info: [{"id": "c311d9a8-cb5a-4e63-8151-152e54f02400", "address": "fa:16:3e:25:0c:39", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc311d9a8-cb", "ovs_interfaceid": "c311d9a8-cb5a-4e63-8151-152e54f02400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:09:48.797394 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Releasing lock "refresh_cache-b7bca13f-0122-4185-997c-70b18dc019f6" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:09:48.798510 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Instance network_info: |[{"id": "c311d9a8-cb5a-4e63-8151-152e54f02400", "address": "fa:16:3e:25:0c:39", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc311d9a8-cb", "ovs_interfaceid": "c311d9a8-cb5a-4e63-8151-152e54f02400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:09:48.800182 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Start _get_guest_xml network_info=[{"id": "c311d9a8-cb5a-4e63-8151-152e54f02400", "address": "fa:16:3e:25:0c:39", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc311d9a8-cb", "ovs_interfaceid": "c311d9a8-cb5a-4e63-8151-152e54f02400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:09:48.806414 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:09:48.808282 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServersTestJSON-server-580295323', uuid='b7bca13f-0122-4185-997c-70b18dc019f6'), owner=OwnerMeta(userid='12364a81a9ea43658a098cdfdb50e3e3', username='tempest-ServersTestJSON-1441848345-project-member', projectid='06fd2a7189d04227bf250a5dcfbc5d96', projectname='tempest-ServersTestJSON-1441848345'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c311d9a8-cb5a-4e63-8151-152e54f02400", "address": "fa:16:3e:25:0c:39", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc311d9a8-cb", "ovs_interfaceid": "c311d9a8-cb5a-4e63-8151-152e54f02400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472588.8077042) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:09:48.810947 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:09:48.811389 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:09:48.815793 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:09:48.815793 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:09:48.815793 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:09:48.815793 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:09:48.815793 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:09:48.815793 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:09:48.815793 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:09:48.815793 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:09:48.815793 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:09:48.816114 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:09:48.816301 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:09:48.816455 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:09:48.816626 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:09:48.816829 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:09:48.821741 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersTestJSON-server-580295323',display_name='tempest-ServersTestJSON-server-580295323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstestjson-server-580295323',id=81,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06fd2a7189d04227bf250a5dcfbc5d96',ramdisk_id='',reservation_id='r-xu2d0kr2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersTestJSON-1441848345',owner_user_name='tempest-ServersTestJSON-1441848345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:09:45Z,user_data=None,user_id='12364a81a9ea43658a098cdfdb50e3e3',uuid=b7bca13f-0122-4185-997c-70b18dc019f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c311d9a8-cb5a-4e63-8151-152e54f02400", "address": "fa:16:3e:25:0c:39", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc311d9a8-cb", "ovs_interfaceid": "c311d9a8-cb5a-4e63-8151-152e54f02400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:09:48.821741 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converting VIF {"id": "c311d9a8-cb5a-4e63-8151-152e54f02400", "address": "fa:16:3e:25:0c:39", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc311d9a8-cb", "ovs_interfaceid": "c311d9a8-cb5a-4e63-8151-152e54f02400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:09:48.821741 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:0c:39,bridge_name='br-int',has_traffic_filtering=True,id=c311d9a8-cb5a-4e63-8151-152e54f02400,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc311d9a8-cb') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:09:48.822451 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lazy-loading 'pci_devices' on Instance uuid b7bca13f-0122-4185-997c-70b18dc019f6 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] End _get_guest_xml xml= Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: b7bca13f-0122-4185-997c-70b18dc019f6 Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: instance-00000051 Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: tempest-ServersTestJSON-server-580295323 Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:09:48 Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: tempest-ServersTestJSON-1441848345-project-member Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: tempest-ServersTestJSON-1441848345 Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: b7bca13f-0122-4185-997c-70b18dc019f6 Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: b7bca13f-0122-4185-997c-70b18dc019f6 Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: Jan 26 19:09:49.331994 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:09:49.334551 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Preparing to wait for external event network-vif-plugged-c311d9a8-cb5a-4e63-8151-152e54f02400 {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:09:49.334551 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "b7bca13f-0122-4185-997c-70b18dc019f6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:49.334551 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "b7bca13f-0122-4185-997c-70b18dc019f6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:49.334627 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "b7bca13f-0122-4185-997c-70b18dc019f6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:49.335797 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersTestJSON-server-580295323',display_name='tempest-ServersTestJSON-server-580295323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstestjson-server-580295323',id=81,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06fd2a7189d04227bf250a5dcfbc5d96',ramdisk_id='',reservation_id='r-xu2d0kr2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersTestJSON-1441848345',owner_user_name='tempest-ServersTestJSON-1441848345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:09:45Z,user_data=None,user_id='12364a81a9ea43658a098cdfdb50e3e3',uuid=b7bca13f-0122-4185-997c-70b18dc019f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c311d9a8-cb5a-4e63-8151-152e54f02400", "address": "fa:16:3e:25:0c:39", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc311d9a8-cb", "ovs_interfaceid": "c311d9a8-cb5a-4e63-8151-152e54f02400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:09:49.335797 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converting VIF {"id": "c311d9a8-cb5a-4e63-8151-152e54f02400", "address": "fa:16:3e:25:0c:39", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc311d9a8-cb", "ovs_interfaceid": "c311d9a8-cb5a-4e63-8151-152e54f02400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:09:49.336686 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:0c:39,bridge_name='br-int',has_traffic_filtering=True,id=c311d9a8-cb5a-4e63-8151-152e54f02400,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc311d9a8-cb') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:09:49.337199 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:0c:39,bridge_name='br-int',has_traffic_filtering=True,id=c311d9a8-cb5a-4e63-8151-152e54f02400,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc311d9a8-cb') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:09:49.337927 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:49.338411 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:49.338907 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:09:49.340152 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:49.340455 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4158e361-e772-5af2-a70e-46ab94d69d5d', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:49.343193 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:49.346375 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:09:49.347605 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:49.352126 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:49.352446 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc311d9a8-cb, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:49.353105 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc311d9a8-cb, col_values=(('qos', UUID('20f92195-862a-44ce-b7bf-950adf3d21f1')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:49.353627 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc311d9a8-cb, col_values=(('external_ids', {'iface-id': 'c311d9a8-cb5a-4e63-8151-152e54f02400', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:0c:39', 'vm-uuid': 'b7bca13f-0122-4185-997c-70b18dc019f6'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:09:49.358817 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:49.361909 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:09:49.367737 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:49.369538 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:0c:39,bridge_name='br-int',has_traffic_filtering=True,id=c311d9a8-cb5a-4e63-8151-152e54f02400,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc311d9a8-cb') Jan 26 19:09:49.579232 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:50.032841 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:09:50.033331 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] VM Stopped (Lifecycle Event) Jan 26 19:09:50.543371 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e366711e-f576-4190-a5e1-df08a1b9b87a None None] [instance: d0ddb554-76ed-49a6-a02b-042680eb310d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:09:50.906126 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:09:50.907836 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:09:50.907836 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] No VIF found with MAC fa:16:3e:25:0c:39, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:09:50.908931 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Using config drive Jan 26 19:09:51.422035 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:51.589786 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Creating config drive at /opt/stack/data/nova/instances/b7bca13f-0122-4185-997c-70b18dc019f6/disk.config Jan 26 19:09:51.593803 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/b7bca13f-0122-4185-997c-70b18dc019f6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpx_34rd41 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:09:51.727889 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/b7bca13f-0122-4185-997c-70b18dc019f6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpx_34rd41" returned: 0 in 0.134s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:09:51.823831 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:51.831312 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:51.838698 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:51.996688 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:52.044494 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:09:52.044693 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] VM Started (Lifecycle Event) Jan 26 19:09:52.175897 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:52.550469 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:09:52.555690 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:09:52.555898 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] VM Paused (Lifecycle Event) Jan 26 19:09:53.059387 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:09:53.063641 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:09:53.569761 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:09:54.356602 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:55.782744 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a932e8bb-3328-485b-9707-52f4ba97a6a1 req-0afff5f3-3a07-4ddf-b81b-91616f314666 service nova] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Received event network-vif-plugged-c311d9a8-cb5a-4e63-8151-152e54f02400 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:09:55.782744 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a932e8bb-3328-485b-9707-52f4ba97a6a1 req-0afff5f3-3a07-4ddf-b81b-91616f314666 service nova] Acquiring lock "b7bca13f-0122-4185-997c-70b18dc019f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:55.782744 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a932e8bb-3328-485b-9707-52f4ba97a6a1 req-0afff5f3-3a07-4ddf-b81b-91616f314666 service nova] Lock "b7bca13f-0122-4185-997c-70b18dc019f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:55.782744 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a932e8bb-3328-485b-9707-52f4ba97a6a1 req-0afff5f3-3a07-4ddf-b81b-91616f314666 service nova] Lock "b7bca13f-0122-4185-997c-70b18dc019f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:55.782744 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a932e8bb-3328-485b-9707-52f4ba97a6a1 req-0afff5f3-3a07-4ddf-b81b-91616f314666 service nova] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Processing event network-vif-plugged-c311d9a8-cb5a-4e63-8151-152e54f02400 {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:09:55.784737 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:09:55.789297 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:09:55.789483 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] VM Resumed (Lifecycle Event) Jan 26 19:09:55.790721 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:09:55.794465 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Instance spawned successfully. Jan 26 19:09:55.794565 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:09:55.887826 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Acquiring lock "e644873b-9046-4305-bda6-e6b01555c047" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:55.888121 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "e644873b-9046-4305-bda6-e6b01555c047" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:56.294017 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:09:56.302408 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:09:56.308092 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:09:56.308578 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:09:56.308851 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:09:56.309472 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:09:56.309690 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:09:56.310233 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:09:56.390626 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:09:56.806159 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:09:56.816845 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Took 10.20 seconds to spawn the instance on the hypervisor. Jan 26 19:09:56.817042 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:09:56.940821 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:56.941040 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:56.944298 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:09:56.944555 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Claim successful on node np0005596550.novalocal Jan 26 19:09:57.178279 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:57.331925 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Took 15.50 seconds to build instance. Jan 26 19:09:57.852505 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fb6094b1-47bf-4302-85d2-1d2c5d2e7ca1 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "b7bca13f-0122-4185-997c-70b18dc019f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.033s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:57.864940 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-dd761f33-2483-4bef-9486-6371aaa23848 req-c807e5dc-fd5e-49f8-9ba3-2d430941264c service nova] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Received event network-vif-plugged-c311d9a8-cb5a-4e63-8151-152e54f02400 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:09:57.865093 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-dd761f33-2483-4bef-9486-6371aaa23848 req-c807e5dc-fd5e-49f8-9ba3-2d430941264c service nova] Acquiring lock "b7bca13f-0122-4185-997c-70b18dc019f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:57.865348 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-dd761f33-2483-4bef-9486-6371aaa23848 req-c807e5dc-fd5e-49f8-9ba3-2d430941264c service nova] Lock "b7bca13f-0122-4185-997c-70b18dc019f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:57.865478 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-dd761f33-2483-4bef-9486-6371aaa23848 req-c807e5dc-fd5e-49f8-9ba3-2d430941264c service nova] Lock "b7bca13f-0122-4185-997c-70b18dc019f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:57.865648 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-dd761f33-2483-4bef-9486-6371aaa23848 req-c807e5dc-fd5e-49f8-9ba3-2d430941264c service nova] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] No waiting events found dispatching network-vif-plugged-c311d9a8-cb5a-4e63-8151-152e54f02400 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:09:57.865865 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-dd761f33-2483-4bef-9486-6371aaa23848 req-c807e5dc-fd5e-49f8-9ba3-2d430941264c service nova] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Received unexpected event network-vif-plugged-c311d9a8-cb5a-4e63-8151-152e54f02400 for instance with vm_state active and task_state None. Jan 26 19:09:58.143158 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:09:58.651644 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:09:59.050957 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "b7bca13f-0122-4185-997c-70b18dc019f6" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:59.051286 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "b7bca13f-0122-4185-997c-70b18dc019f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:59.051404 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "b7bca13f-0122-4185-997c-70b18dc019f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:59.051571 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "b7bca13f-0122-4185-997c-70b18dc019f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:59.051741 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "b7bca13f-0122-4185-997c-70b18dc019f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:59.054738 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Terminating instance Jan 26 19:09:59.161121 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.220s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:59.161391 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:09:59.398753 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:59.559747 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:09:59.582080 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:59.592112 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:59.667735 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:09:59.668091 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:09:59.668487 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:59.669235 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:09:59.740620 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:59.747808 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:59.751807 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48586137c66f4adcbebed7d64bf6c678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159fa4c355834fd99ccce809dd17e5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:09:59.786911 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:59.794902 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:09:59.853795 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Instance destroyed successfully. Jan 26 19:09:59.853795 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lazy-loading 'resources' on Instance uuid b7bca13f-0122-4185-997c-70b18dc019f6 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:09:59.921588 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7ea9af34-a12d-494e-a862-f2e6a528538f req-3eea7910-a1a7-404f-9a81-cdc5aed24d39 service nova] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Received event network-vif-unplugged-c311d9a8-cb5a-4e63-8151-152e54f02400 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:09:59.921743 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7ea9af34-a12d-494e-a862-f2e6a528538f req-3eea7910-a1a7-404f-9a81-cdc5aed24d39 service nova] Acquiring lock "b7bca13f-0122-4185-997c-70b18dc019f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:09:59.921927 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7ea9af34-a12d-494e-a862-f2e6a528538f req-3eea7910-a1a7-404f-9a81-cdc5aed24d39 service nova] Lock "b7bca13f-0122-4185-997c-70b18dc019f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:09:59.922049 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7ea9af34-a12d-494e-a862-f2e6a528538f req-3eea7910-a1a7-404f-9a81-cdc5aed24d39 service nova] Lock "b7bca13f-0122-4185-997c-70b18dc019f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:09:59.922184 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7ea9af34-a12d-494e-a862-f2e6a528538f req-3eea7910-a1a7-404f-9a81-cdc5aed24d39 service nova] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] No waiting events found dispatching network-vif-unplugged-c311d9a8-cb5a-4e63-8151-152e54f02400 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:09:59.922310 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7ea9af34-a12d-494e-a862-f2e6a528538f req-3eea7910-a1a7-404f-9a81-cdc5aed24d39 service nova] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Received event network-vif-unplugged-c311d9a8-cb5a-4e63-8151-152e54f02400 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:10:00.190820 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:10:00.356423 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServersTestJSON-server-580295323',display_name='tempest-ServersTestJSON-server-580295323',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstestjson-server-580295323',id=81,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:09:56Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='06fd2a7189d04227bf250a5dcfbc5d96',ramdisk_id='',reservation_id='r-xu2d0kr2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersTestJSON-1441848345',owner_user_name='tempest-ServersTestJSON-1441848345-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:09:56Z,user_data=None,user_id='12364a81a9ea43658a098cdfdb50e3e3',uuid=b7bca13f-0122-4185-997c-70b18dc019f6,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c311d9a8-cb5a-4e63-8151-152e54f02400", "address": "fa:16:3e:25:0c:39", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc311d9a8-cb", "ovs_interfaceid": "c311d9a8-cb5a-4e63-8151-152e54f02400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:10:00.356613 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converting VIF {"id": "c311d9a8-cb5a-4e63-8151-152e54f02400", "address": "fa:16:3e:25:0c:39", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc311d9a8-cb", "ovs_interfaceid": "c311d9a8-cb5a-4e63-8151-152e54f02400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:10:00.357415 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:0c:39,bridge_name='br-int',has_traffic_filtering=True,id=c311d9a8-cb5a-4e63-8151-152e54f02400,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc311d9a8-cb') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:10:00.357415 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:0c:39,bridge_name='br-int',has_traffic_filtering=True,id=c311d9a8-cb5a-4e63-8151-152e54f02400,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc311d9a8-cb') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:10:00.358479 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:00.358737 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc311d9a8-cb, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:00.359731 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:00.361279 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:00.361930 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:00.362107 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=20f92195-862a-44ce-b7bf-950adf3d21f1) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:00.362584 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:00.364236 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:00.367670 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:0c:39,bridge_name='br-int',has_traffic_filtering=True,id=c311d9a8-cb5a-4e63-8151-152e54f02400,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc311d9a8-cb') Jan 26 19:10:00.368177 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Deleting instance files /opt/stack/data/nova/instances/b7bca13f-0122-4185-997c-70b18dc019f6_del Jan 26 19:10:00.368965 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Deletion of /opt/stack/data/nova/instances/b7bca13f-0122-4185-997c-70b18dc019f6_del complete Jan 26 19:10:00.392193 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Successfully created port: 6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:10:00.696418 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:10:00.879275 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Took 1.32 seconds to destroy the instance on the hypervisor. Jan 26 19:10:00.879726 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:10:00.880156 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:10:00.880349 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:10:00.880686 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:01.463769 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.block_device [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Booting with volume 4e3fe1e3-916c-4c11-b288-1ca6609a25da at /dev/vda Jan 26 19:10:01.490513 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:01.523259 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': True, 'host': 'np0005596550.novalocal', 'execute': None}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:10:01.527410 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:01.535509 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:01.536010 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d019b0-38f8-4a16-885c-3e99f7a7f24f]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:01.538114 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[48eebf8c-df10-4245-97d3-69d947f15e96]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:10:01.538114 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:10:01.538114 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:10:01.538114 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:10:01.538114 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:01.538114 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:10:01.538114 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:10:01.538114 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:01.538114 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:10:01.538114 np0005596550.novalocal nova-compute[189076]: with open_scini_device() as fd: Jan 26 19:10:01.538114 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:01.538114 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:10:01.538114 np0005596550.novalocal nova-compute[189076]: return next(self.gen) Jan 26 19:10:01.538114 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^ Jan 26 19:10:01.538114 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:10:01.538114 np0005596550.novalocal nova-compute[189076]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:10:01.538114 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:01.538114 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:10:01.538407 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[48eebf8c-df10-4245-97d3-69d947f15e96]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:01.538953 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.scaleio [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:10:01.539065 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.scaleio [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:10:01.542882 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:01.552339 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:01.552867 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af3bc3c-d2f0-4871-89bc-8f2c964bf354]: (4, ('/dev/vda2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:01.553760 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:01.565335 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:01.565461 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[175ae22c-9ed8-428c-a46c-f302839d033f]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:01.567658 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e03e465-ca46-4ca6-b079-4483d95af1aa]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:01.568069 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Running cmd (subprocess): nvme version {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:01.623675 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] 'nvme version' failed. Not Retrying. {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:10:01.624044 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] nvme not present on system {{(pid=189076) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:10:01.628819 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=189076) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:10:01.628819 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.lightos [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fe13:1fe6', 'fe80::4829:71ff:fe7a:59a1', 'fe80::fc16:3eff:fe75:d6f4'] Jan 26 19:10:01.628819 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:10:01.629041 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:10:01.629395 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': True, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fe13:1fe6', 'fe80::4829:71ff:fe7a:59a1', 'fe80::fc16:3eff:fe75:d6f4']} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:10:01.629731 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.block_device [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Updating existing volume attachment record: 8d3c0fbc-7e04-40dc-be09-65cd3a1ab58c {{(pid=189076) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jan 26 19:10:01.861181 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Successfully updated port: 6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:10:01.924982 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-198b38b5-bcdb-4327-b810-46bb3a36d5f9 req-734353ce-6a37-4883-b19d-44bbb6b969d6 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Received event network-changed-6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:01.924982 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-198b38b5-bcdb-4327-b810-46bb3a36d5f9 req-734353ce-6a37-4883-b19d-44bbb6b969d6 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Refreshing instance network info cache due to event network-changed-6f62e7be-24d4-4385-85c3-ad547148947c. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:10:01.924982 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-198b38b5-bcdb-4327-b810-46bb3a36d5f9 req-734353ce-6a37-4883-b19d-44bbb6b969d6 service nova] Acquiring lock "refresh_cache-e644873b-9046-4305-bda6-e6b01555c047" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:10:01.924982 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-198b38b5-bcdb-4327-b810-46bb3a36d5f9 req-734353ce-6a37-4883-b19d-44bbb6b969d6 service nova] Acquired lock "refresh_cache-e644873b-9046-4305-bda6-e6b01555c047" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:10:01.924982 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-198b38b5-bcdb-4327-b810-46bb3a36d5f9 req-734353ce-6a37-4883-b19d-44bbb6b969d6 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Refreshing network info cache for port 6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:10:01.952685 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-1dddd18b-4bdb-42e1-b338-650c49a83072 req-8a50d2bc-e62a-41c0-9122-dc49be57f752 service nova] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Received event network-vif-unplugged-c311d9a8-cb5a-4e63-8151-152e54f02400 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:01.952901 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1dddd18b-4bdb-42e1-b338-650c49a83072 req-8a50d2bc-e62a-41c0-9122-dc49be57f752 service nova] Acquiring lock "b7bca13f-0122-4185-997c-70b18dc019f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:01.953083 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1dddd18b-4bdb-42e1-b338-650c49a83072 req-8a50d2bc-e62a-41c0-9122-dc49be57f752 service nova] Lock "b7bca13f-0122-4185-997c-70b18dc019f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:01.953249 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1dddd18b-4bdb-42e1-b338-650c49a83072 req-8a50d2bc-e62a-41c0-9122-dc49be57f752 service nova] Lock "b7bca13f-0122-4185-997c-70b18dc019f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:01.953417 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-1dddd18b-4bdb-42e1-b338-650c49a83072 req-8a50d2bc-e62a-41c0-9122-dc49be57f752 service nova] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] No waiting events found dispatching network-vif-unplugged-c311d9a8-cb5a-4e63-8151-152e54f02400 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:10:01.953563 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-1dddd18b-4bdb-42e1-b338-650c49a83072 req-8a50d2bc-e62a-41c0-9122-dc49be57f752 service nova] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Received event network-vif-unplugged-c311d9a8-cb5a-4e63-8151-152e54f02400 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:10:01.954723 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-1dddd18b-4bdb-42e1-b338-650c49a83072 req-8a50d2bc-e62a-41c0-9122-dc49be57f752 service nova] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Received event network-vif-deleted-c311d9a8-cb5a-4e63-8151-152e54f02400 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:01.954723 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-1dddd18b-4bdb-42e1-b338-650c49a83072 req-8a50d2bc-e62a-41c0-9122-dc49be57f752 service nova] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Neutron deleted interface c311d9a8-cb5a-4e63-8151-152e54f02400; detaching it from the instance and deleting it from the info cache Jan 26 19:10:01.954723 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-1dddd18b-4bdb-42e1-b338-650c49a83072 req-8a50d2bc-e62a-41c0-9122-dc49be57f752 service nova] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:10:02.179706 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:02.368172 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Acquiring lock "refresh_cache-e644873b-9046-4305-bda6-e6b01555c047" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:10:02.368172 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:10:02.426911 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-198b38b5-bcdb-4327-b810-46bb3a36d5f9 req-734353ce-6a37-4883-b19d-44bbb6b969d6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:02.459015 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-1dddd18b-4bdb-42e1-b338-650c49a83072 req-8a50d2bc-e62a-41c0-9122-dc49be57f752 service nova] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Detach interface failed, port_id=c311d9a8-cb5a-4e63-8151-152e54f02400, reason: Instance b7bca13f-0122-4185-997c-70b18dc019f6 could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:10:02.506162 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-198b38b5-bcdb-4327-b810-46bb3a36d5f9 req-734353ce-6a37-4883-b19d-44bbb6b969d6 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:10:02.681830 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-198b38b5-bcdb-4327-b810-46bb3a36d5f9 req-734353ce-6a37-4883-b19d-44bbb6b969d6 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:10:02.872225 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Took 1.99 seconds to deallocate network for instance. Jan 26 19:10:03.184554 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-198b38b5-bcdb-4327-b810-46bb3a36d5f9 req-734353ce-6a37-4883-b19d-44bbb6b969d6 service nova] Releasing lock "refresh_cache-e644873b-9046-4305-bda6-e6b01555c047" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:10:03.185475 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Acquired lock "refresh_cache-e644873b-9046-4305-bda6-e6b01555c047" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:10:03.185705 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:10:03.384572 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:03.385145 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:03.552819 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:10:03.928590 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:10:04.056506 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:10:04.129726 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:04.293804 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Updating instance_info_cache with network_info: [{"id": "6f62e7be-24d4-4385-85c3-ad547148947c", "address": "fa:16:3e:34:84:25", "network": {"id": "d63f3398-d114-48c7-9a53-9b0dff093c9d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833956753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "159fa4c355834fd99ccce809dd17e5fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f62e7be-24", "ovs_interfaceid": "6f62e7be-24d4-4385-85c3-ad547148947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:10:04.601371 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.216s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:04.797892 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Releasing lock "refresh_cache-e644873b-9046-4305-bda6-e6b01555c047" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:10:04.798530 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Instance network_info: |[{"id": "6f62e7be-24d4-4385-85c3-ad547148947c", "address": "fa:16:3e:34:84:25", "network": {"id": "d63f3398-d114-48c7-9a53-9b0dff093c9d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833956753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "159fa4c355834fd99ccce809dd17e5fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f62e7be-24", "ovs_interfaceid": "6f62e7be-24d4-4385-85c3-ad547148947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:10:05.076306 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Deleted allocations for instance b7bca13f-0122-4185-997c-70b18dc019f6 Jan 26 19:10:05.363636 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:06.088292 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0a7601b2-3a17-4bd3-8aee-0e2b94765c81 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "b7bca13f-0122-4185-997c-70b18dc019f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.037s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:07.181832 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:07.329352 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "459cac8e-7df6-4a91-940f-fea48ca87f18" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:07.329674 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "459cac8e-7df6-4a91-940f-fea48ca87f18" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:07.329982 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "459cac8e-7df6-4a91-940f-fea48ca87f18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:07.330892 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "459cac8e-7df6-4a91-940f-fea48ca87f18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:07.330892 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "459cac8e-7df6-4a91-940f-fea48ca87f18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:07.335405 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Terminating instance Jan 26 19:10:07.582326 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:10:07.583535 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:10:07.583919 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Creating image(s) Jan 26 19:10:07.584371 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Did not create local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5295}} Jan 26 19:10:07.584595 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Ensure instance console log exists: /opt/stack/data/nova/instances/e644873b-9046-4305-bda6-e6b01555c047/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:10:07.584942 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:07.585185 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:07.585387 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:07.587549 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Start _get_guest_xml network_info=[{"id": "6f62e7be-24d4-4385-85c3-ad547148947c", "address": "fa:16:3e:34:84:25", "network": {"id": "d63f3398-d114-48c7-9a53-9b0dff093c9d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833956753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "159fa4c355834fd99ccce809dd17e5fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f62e7be-24", "ovs_interfaceid": "6f62e7be-24d4-4385-85c3-ad547148947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '8d3c0fbc-7e04-40dc-be09-65cd3a1ab58c', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'target_lun': 0, 'volume_id': '4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'auth_method': 'CHAP', 'auth_username': 'vLGbFUG9rYjACzbmVoRC', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e644873b-9046-4305-bda6-e6b01555c047', 'attached_at': '', 'detached_at': '', 'volume_id': '4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'serial': '4e3fe1e3-916c-4c11-b288-1ca6609a25da'}, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:10:07.592682 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:10:07.594045 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-1897556847', uuid='e644873b-9046-4305-bda6-e6b01555c047'), owner=OwnerMeta(userid='48586137c66f4adcbebed7d64bf6c678', username='tempest-ServerActionsV293TestJSON-1845614456-project-member', projectid='159fa4c355834fd99ccce809dd17e5fd', projectname='tempest-ServerActionsV293TestJSON-1845614456'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6f62e7be-24d4-4385-85c3-ad547148947c", "address": "fa:16:3e:34:84:25", "network": {"id": "d63f3398-d114-48c7-9a53-9b0dff093c9d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833956753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "159fa4c355834fd99ccce809dd17e5fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f62e7be-24", "ovs_interfaceid": "6f62e7be-24d4-4385-85c3-ad547148947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472607.5935445) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:10:07.595752 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:10:07.596346 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:10:07.597881 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:10:07.598379 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:10:07.599445 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:10:07.599880 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:10:07.600133 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:10:07.600343 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:10:07.600610 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:10:07.600840 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:10:07.601042 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:10:07.601329 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:10:07.601542 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:10:07.601761 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:10:07.602029 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:10:07.602284 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:10:07.605279 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Calling os-brick to attach iSCSI Volume {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jan 26 19:10:07.606093 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'target_lun': 0, 'volume_id': '4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'auth_method': 'CHAP', 'auth_username': 'vLGbFUG9rYjACzbmVoRC', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:10:07.606412 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:10:07.606917 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:10:07.607155 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'target_lun': 0, 'volume_id': '4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'auth_method': 'CHAP', 'auth_username': 'vLGbFUG9rYjACzbmVoRC', 'auth_password': 'SbExB4HwxUFZppPd', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True} {{(pid=189076) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:10:07.608184 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:07.615660 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:10:07.616832 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[3245898f-c4f6-4cec-a515-b4ca3ba840ec]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:10:07.616832 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:10:07.616832 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:10:07.616832 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:10:07.616832 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:07.616832 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:10:07.616832 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:10:07.616832 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:07.616832 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:10:07.616832 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:10:07.616832 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:07.616832 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:10:07.616832 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:10:07.616832 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:07.616832 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:10:07.616832 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:10:07.616832 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:07.616832 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:10:07.616832 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:10:07.616832 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:10:07.616832 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:10:07.616832 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:10:07.617882 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[3245898f-c4f6-4cec-a515-b4ca3ba840ec]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:07.618573 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:10:07.619106 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:10:07.619390 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:10:07.620551 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:07.632823 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260" returned: 21 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:07.632998 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e79090-5a27-40e0-8c99-6ee1564da21c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:07.633386 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:10:07.633386 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:10:07.634895 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --interface default --op new {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:07.650388 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.015s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:07.650725 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fea0632-2309-48f6-b273-d86f241444ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:07.651348 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da] added Jan 26 19:10:07.651348 np0005596550.novalocal nova-compute[189076]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:10:07.651348 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:10:07.651348 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:10:07.651348 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:10:07.651671 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=189076) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:10:07.652219 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.033(s), this was the 1st time calling it. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:10:07.652618 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:10:07.840303 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:10:07.875530 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:07.882756 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:07.993412 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:08.000679 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:08.035210 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-74fc1166-d9bd-4146-81f6-9ed649c75b65 req-1dba075e-821d-43c8-93a4-241c4384d537 service nova] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Received event network-vif-unplugged-ff64ae6e-664d-41b4-9091-d338976ff780 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:08.035440 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-74fc1166-d9bd-4146-81f6-9ed649c75b65 req-1dba075e-821d-43c8-93a4-241c4384d537 service nova] Acquiring lock "459cac8e-7df6-4a91-940f-fea48ca87f18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:08.035623 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-74fc1166-d9bd-4146-81f6-9ed649c75b65 req-1dba075e-821d-43c8-93a4-241c4384d537 service nova] Lock "459cac8e-7df6-4a91-940f-fea48ca87f18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:08.035763 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-74fc1166-d9bd-4146-81f6-9ed649c75b65 req-1dba075e-821d-43c8-93a4-241c4384d537 service nova] Lock "459cac8e-7df6-4a91-940f-fea48ca87f18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:08.035971 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-74fc1166-d9bd-4146-81f6-9ed649c75b65 req-1dba075e-821d-43c8-93a4-241c4384d537 service nova] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] No waiting events found dispatching network-vif-unplugged-ff64ae6e-664d-41b4-9091-d338976ff780 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:10:08.036104 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-74fc1166-d9bd-4146-81f6-9ed649c75b65 req-1dba075e-821d-43c8-93a4-241c4384d537 service nova] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Received event network-vif-unplugged-ff64ae6e-664d-41b4-9091-d338976ff780 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:10:08.075217 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:08.088213 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:08.123757 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Instance destroyed successfully. Jan 26 19:10:08.125518 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lazy-loading 'resources' on Instance uuid 459cac8e-7df6-4a91-940f-fea48ca87f18 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:10:08.246889 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:08.252532 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:08.378238 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:08.383056 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:08.630794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:09:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServersTestJSON-server-580295323',display_name='tempest-ServersTestJSON-server-580295323',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstestjson-server-580295323',id=80,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:09:38Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='06fd2a7189d04227bf250a5dcfbc5d96',ramdisk_id='',reservation_id='r-0t880jrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersTestJSON-1441848345',owner_user_name='tempest-ServersTestJSON-1441848345-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:09:38Z,user_data=None,user_id='12364a81a9ea43658a098cdfdb50e3e3',uuid=459cac8e-7df6-4a91-940f-fea48ca87f18,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff64ae6e-664d-41b4-9091-d338976ff780", "address": "fa:16:3e:75:d6:f4", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64ae6e-66", "ovs_interfaceid": "ff64ae6e-664d-41b4-9091-d338976ff780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:10:08.630794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converting VIF {"id": "ff64ae6e-664d-41b4-9091-d338976ff780", "address": "fa:16:3e:75:d6:f4", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64ae6e-66", "ovs_interfaceid": "ff64ae6e-664d-41b4-9091-d338976ff780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:10:08.630794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:d6:f4,bridge_name='br-int',has_traffic_filtering=True,id=ff64ae6e-664d-41b4-9091-d338976ff780,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64ae6e-66') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:10:08.631068 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:d6:f4,bridge_name='br-int',has_traffic_filtering=True,id=ff64ae6e-664d-41b4-9091-d338976ff780,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64ae6e-66') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:10:08.631439 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:08.631742 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff64ae6e-66, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:08.633062 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:08.635296 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:08.635988 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:08.636239 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8cc75d1-346d-4bc1-9b77-6dc5d99ee2d6) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:08.636739 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:08.639481 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:10:08.641110 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:d6:f4,bridge_name='br-int',has_traffic_filtering=True,id=ff64ae6e-664d-41b4-9091-d338976ff780,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64ae6e-66') Jan 26 19:10:08.641487 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Deleting instance files /opt/stack/data/nova/instances/459cac8e-7df6-4a91-940f-fea48ca87f18_del Jan 26 19:10:08.642005 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Deletion of /opt/stack/data/nova/instances/459cac8e-7df6-4a91-940f-fea48ca87f18_del complete Jan 26 19:10:08.654035 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:10:08.655240 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:08.663465 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:08.663719 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e57542-0c46-4ce9-b5ab-cc3cde189656]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.name = iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.tpgt = -1 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.startup = automatic Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.leading_login = No Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.iscsi_ifacename = default Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.net_ifacename = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.ipaddress = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.prefix_len = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.hwaddress = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.transport_name = tcp Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.initiatorname = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.state = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.vlan_id = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.vlan_priority = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.vlan_state = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.iface_num = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.mtu = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.port = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.bootproto = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.subnet_mask = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.gateway = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id_state = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.dhcp_dns = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.dhcp_learn_iqn = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.dhcp_req_vendor_id_state = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id_state = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.dhcp_slp_da = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.fragmentation = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.gratuitous_arp = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.incoming_forwarding = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.tos_state = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.tos = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.ttl = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.delayed_ack = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.tcp_nagle = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf_state = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.tcp_timer_scale = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.tcp_timestamp = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.redirect = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.def_task_mgmt_timeout = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.header_digest = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.data_digest = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.immediate_data = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.initial_r2t = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.data_seq_inorder = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.data_pdu_inorder = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.erl = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.max_receive_data_len = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.first_burst_len = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.max_outstanding_r2t = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.max_burst_len = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.chap_auth = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.bidi_chap = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.strict_login_compliance = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.discovery_auth = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: iface.discovery_logout = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.discovery_address = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.discovery_port = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.discovery_type = fw Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.initial_cmdsn = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.initial_login_retry_max = 8 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.xmit_thread_priority = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.cmds_max = 128 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.queue_depth = 32 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.nr_sessions = 1 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.auth.authmethod = None Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.auth.username = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.auth.password = *** Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.auth.username_in = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.auth.password_in = Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.timeo.replacement_timeout = 120 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FastAbort = Yes Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.InitialR2T = No Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ImmediateData = Yes Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxConnections = 1 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ERL = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.scan = auto Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.reopen_max = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.session.conn_reopen_log_freq = 1 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.conn[0].address = 38.102.83.18 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.conn[0].port = 3260 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.conn[0].startup = manual Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.window_size = 524288 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.DataDigest = None Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.IFMarker = No Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.OFMarker = No Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: # END RECORD Jan 26 19:10:08.664724 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:10:08.666674 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:08.674720 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:08.675111 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[40780560-8b3b-48fc-b62c-543e965e756d]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:08.675494 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:10:08.676263 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:08.688224 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:08.688355 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc47348-9f77-49d0-a7d2-8bda6f25ff9f]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:08.688737 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:10:08.690042 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.session.auth.username -v vLGbFUG9rYjACzbmVoRC {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:08.698548 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.session.auth.username -v vLGbFUG9rYjACzbmVoRC" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:08.698693 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5a5e60-1e33-4999-8715-34beae2adc35]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:08.699185 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vLGbFUG9rYjACzbmVoRC'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:10:08.700056 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:08.710840 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:08.710958 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9daec3-73da-4c90-843e-5fb623f5a1f2]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:08.711368 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:10:08.712093 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:08.719263 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:08.719380 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c07b2f7-597b-43e0-8a4c-d618692095b1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:08.719645 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jan 26 19:10:08.719645 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:10:08.719795 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jan 26 19:10:08.719795 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:10:08.719928 np0005596550.novalocal nova-compute[189076]: WARNING os_brick.initiator.connectors.iscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jan 26 19:10:08.719928 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:08.720561 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --login {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:08.735700 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --login" returned: 0 in 0.015s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:08.735884 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0908034-9ec1-474b-98f6-9fb4cbe4b48d]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:08.736262 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da, portal: 38.102.83.18,3260] successful. Jan 26 19:10:08.736262 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:10:08.737001 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:08.748639 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:08.748893 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e75d6a-eb82-4678-a0f1-54f08c80616c]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:08.749254 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:10:08.749909 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:08.760231 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:08.760384 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[132b276d-35c1-4fef-a7ac-40af9fc523cc]: (4, ('tcp: [13] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:08.760689 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da (non-flash) Jan 26 19:10:08.760689 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:10:08.760885 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsi session list stdout=tcp: [13] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da (non-flash) Jan 26 19:10:08.760885 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:10:08.761198 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:10:08.761369 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Connected to 38.102.83.18:3260 {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:10:08.761758 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] HCTL ('2', '-', '-', 0) found on session 13 with lun 0 {{(pid=189076) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:10:08.761939 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Scanning host 2 c: -, t: -, l: 0) {{(pid=189076) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:10:08.762667 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host2/scan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:08.784793 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host2/scan" returned: 0 in 0.021s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:08.784793 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be3dcf8-8097-4026-bf35-b619c35578fa]: (4, ('- - 0', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:08.785052 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Searching for a device in session 13 and hctl ['2', '*', '*', 0] yield: sda {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:10:08.785448 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Connected to sda using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'target_lun': 0, 'volume_id': '4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'auth_method': 'CHAP', 'auth_username': 'vLGbFUG9rYjACzbmVoRC', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True} {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:10:09.149816 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Took 1.31 seconds to destroy the instance on the hypervisor. Jan 26 19:10:09.150035 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:10:09.150238 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:10:09.150310 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:10:09.150541 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:09.238803 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:09.788130 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.181s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:10:09.789004 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] <== connect_volume: return (2181ms) {'type': 'block', 'scsi_wwn': '36001405e65b5de1f90e4d8581be0a11a', 'path': '/dev/sda'} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:10:09.789004 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '36001405e65b5de1f90e4d8581be0a11a', 'path': '/dev/sda'} {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jan 26 19:10:10.070417 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-67f77c22-3005-4d03-9d0f-012f9e92655a req-fa8cd89b-d9a7-432f-9bce-021646ab9f34 service nova] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Received event network-vif-unplugged-ff64ae6e-664d-41b4-9091-d338976ff780 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:10.070688 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-67f77c22-3005-4d03-9d0f-012f9e92655a req-fa8cd89b-d9a7-432f-9bce-021646ab9f34 service nova] Acquiring lock "459cac8e-7df6-4a91-940f-fea48ca87f18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:10.070923 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-67f77c22-3005-4d03-9d0f-012f9e92655a req-fa8cd89b-d9a7-432f-9bce-021646ab9f34 service nova] Lock "459cac8e-7df6-4a91-940f-fea48ca87f18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:10.071132 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-67f77c22-3005-4d03-9d0f-012f9e92655a req-fa8cd89b-d9a7-432f-9bce-021646ab9f34 service nova] Lock "459cac8e-7df6-4a91-940f-fea48ca87f18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:10.071452 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-67f77c22-3005-4d03-9d0f-012f9e92655a req-fa8cd89b-d9a7-432f-9bce-021646ab9f34 service nova] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] No waiting events found dispatching network-vif-unplugged-ff64ae6e-664d-41b4-9091-d338976ff780 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:10:10.071555 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-67f77c22-3005-4d03-9d0f-012f9e92655a req-fa8cd89b-d9a7-432f-9bce-021646ab9f34 service nova] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Received event network-vif-unplugged-ff64ae6e-664d-41b4-9091-d338976ff780 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:10:10.071830 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-67f77c22-3005-4d03-9d0f-012f9e92655a req-fa8cd89b-d9a7-432f-9bce-021646ab9f34 service nova] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Received event network-vif-deleted-ff64ae6e-664d-41b4-9091-d338976ff780 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:10.072082 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-67f77c22-3005-4d03-9d0f-012f9e92655a req-fa8cd89b-d9a7-432f-9bce-021646ab9f34 service nova] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Neutron deleted interface ff64ae6e-664d-41b4-9091-d338976ff780; detaching it from the instance and deleting it from the info cache Jan 26 19:10:10.072301 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-67f77c22-3005-4d03-9d0f-012f9e92655a req-fa8cd89b-d9a7-432f-9bce-021646ab9f34 service nova] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:10:10.105981 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:10:10.296829 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:09:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1897556847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionsv293testjson-server-1897556847',id=82,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMleCBrZBqJ3bjgXVIsALOmKVUFCcb37z9LQkq4/iqQlFLQoYPVskU6EQUtERGdJ+j9iydCEKOj11OCXZNr3wo6GhNqY2IPdqhyyzdKUIx044D+00FnIK90zBOamNJRrA==',key_name='tempest-keypair-352548147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='159fa4c355834fd99ccce809dd17e5fd',ramdisk_id='',reservation_id='r-uve25rn8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1845614456',owner_user_name='tempest-ServerActionsV293TestJSON-1845614456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:10:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48586137c66f4adcbebed7d64bf6c678',uuid=e644873b-9046-4305-bda6-e6b01555c047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f62e7be-24d4-4385-85c3-ad547148947c", "address": "fa:16:3e:34:84:25", "network": {"id": "d63f3398-d114-48c7-9a53-9b0dff093c9d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833956753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "159fa4c355834fd99ccce809dd17e5fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f62e7be-24", "ovs_interfaceid": "6f62e7be-24d4-4385-85c3-ad547148947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:10:10.297214 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Converting VIF {"id": "6f62e7be-24d4-4385-85c3-ad547148947c", "address": "fa:16:3e:34:84:25", "network": {"id": "d63f3398-d114-48c7-9a53-9b0dff093c9d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833956753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "159fa4c355834fd99ccce809dd17e5fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f62e7be-24", "ovs_interfaceid": "6f62e7be-24d4-4385-85c3-ad547148947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:10:10.298133 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:84:25,bridge_name='br-int',has_traffic_filtering=True,id=6f62e7be-24d4-4385-85c3-ad547148947c,network=Network(d63f3398-d114-48c7-9a53-9b0dff093c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f62e7be-24') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:10:10.299318 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lazy-loading 'pci_devices' on Instance uuid e644873b-9046-4305-bda6-e6b01555c047 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:10:10.578331 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-67f77c22-3005-4d03-9d0f-012f9e92655a req-fa8cd89b-d9a7-432f-9bce-021646ab9f34 service nova] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Detach interface failed, port_id=ff64ae6e-664d-41b4-9091-d338976ff780, reason: Instance 459cac8e-7df6-4a91-940f-fea48ca87f18 could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:10:10.609140 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Took 1.46 seconds to deallocate network for instance. Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] End _get_guest_xml xml= Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: e644873b-9046-4305-bda6-e6b01555c047 Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: instance-00000052 Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsV293TestJSON-server-1897556847 Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:10:07 Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsV293TestJSON-1845614456-project-member Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsV293TestJSON-1845614456 Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: e644873b-9046-4305-bda6-e6b01555c047 Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: e644873b-9046-4305-bda6-e6b01555c047 Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: 4e3fe1e3-916c-4c11-b288-1ca6609a25da Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:10.804343 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:10:10.806901 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Preparing to wait for external event network-vif-plugged-6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:10:10.806901 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Acquiring lock "e644873b-9046-4305-bda6-e6b01555c047-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:10.806901 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:10.806901 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:10.806901 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:09:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1897556847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionsv293testjson-server-1897556847',id=82,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMleCBrZBqJ3bjgXVIsALOmKVUFCcb37z9LQkq4/iqQlFLQoYPVskU6EQUtERGdJ+j9iydCEKOj11OCXZNr3wo6GhNqY2IPdqhyyzdKUIx044D+00FnIK90zBOamNJRrA==',key_name='tempest-keypair-352548147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='159fa4c355834fd99ccce809dd17e5fd',ramdisk_id='',reservation_id='r-uve25rn8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1845614456',owner_user_name='tempest-ServerActionsV293TestJSON-1845614456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:10:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48586137c66f4adcbebed7d64bf6c678',uuid=e644873b-9046-4305-bda6-e6b01555c047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f62e7be-24d4-4385-85c3-ad547148947c", "address": "fa:16:3e:34:84:25", "network": {"id": "d63f3398-d114-48c7-9a53-9b0dff093c9d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833956753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "159fa4c355834fd99ccce809dd17e5fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f62e7be-24", "ovs_interfaceid": "6f62e7be-24d4-4385-85c3-ad547148947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:10:10.807163 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Converting VIF {"id": "6f62e7be-24d4-4385-85c3-ad547148947c", "address": "fa:16:3e:34:84:25", "network": {"id": "d63f3398-d114-48c7-9a53-9b0dff093c9d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833956753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "159fa4c355834fd99ccce809dd17e5fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f62e7be-24", "ovs_interfaceid": "6f62e7be-24d4-4385-85c3-ad547148947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:10:10.807163 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:84:25,bridge_name='br-int',has_traffic_filtering=True,id=6f62e7be-24d4-4385-85c3-ad547148947c,network=Network(d63f3398-d114-48c7-9a53-9b0dff093c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f62e7be-24') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:10:10.807163 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:84:25,bridge_name='br-int',has_traffic_filtering=True,id=6f62e7be-24d4-4385-85c3-ad547148947c,network=Network(d63f3398-d114-48c7-9a53-9b0dff093c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f62e7be-24') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:10:10.807322 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:10.807681 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:10.808143 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:10:10.808953 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:10.809189 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c97be13f-2357-51af-afdd-bf482e5d6edb', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:10.848879 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:10.854067 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:10.856357 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:10.856670 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f62e7be-24, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:10.857247 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f62e7be-24, col_values=(('qos', UUID('d7502fdf-33b7-421c-96d4-18448a795206')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:10.857540 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f62e7be-24, col_values=(('external_ids', {'iface-id': '6f62e7be-24d4-4385-85c3-ad547148947c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:84:25', 'vm-uuid': 'e644873b-9046-4305-bda6-e6b01555c047'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:10.859090 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:10.863384 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:10:10.872641 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:10.874021 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:84:25,bridge_name='br-int',has_traffic_filtering=True,id=6f62e7be-24d4-4385-85c3-ad547148947c,network=Network(d63f3398-d114-48c7-9a53-9b0dff093c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f62e7be-24') Jan 26 19:10:11.119688 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:11.119688 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:11.333669 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:10:11.838392 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:10:12.344908 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.225s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:12.399842 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:10:12.400237 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:10:12.400664 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] No VIF found with MAC fa:16:3e:34:84:25, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:10:12.401596 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Using config drive Jan 26 19:10:12.433404 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Deleted allocations for instance 459cac8e-7df6-4a91-940f-fea48ca87f18 Jan 26 19:10:12.913505 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:13.066831 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Creating config drive at /opt/stack/data/nova/instances/e644873b-9046-4305-bda6-e6b01555c047/disk.config Jan 26 19:10:13.072151 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/e644873b-9046-4305-bda6-e6b01555c047/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpr7wp_2i5 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:13.206014 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/e644873b-9046-4305-bda6-e6b01555c047/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpr7wp_2i5" returned: 0 in 0.133s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:13.339309 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:13.349817 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:13.451260 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b42116cd-bb5d-49cc-a09f-4345a2dfe167 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "459cac8e-7df6-4a91-940f-fea48ca87f18" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.121s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:13.525472 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-04a71443-d707-41ec-9276-680926d76b50 req-82bb79cf-9e6a-449e-806f-e8a750640062 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Received event network-vif-plugged-6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:13.525734 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-04a71443-d707-41ec-9276-680926d76b50 req-82bb79cf-9e6a-449e-806f-e8a750640062 service nova] Acquiring lock "e644873b-9046-4305-bda6-e6b01555c047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:13.525994 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-04a71443-d707-41ec-9276-680926d76b50 req-82bb79cf-9e6a-449e-806f-e8a750640062 service nova] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:13.526166 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-04a71443-d707-41ec-9276-680926d76b50 req-82bb79cf-9e6a-449e-806f-e8a750640062 service nova] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:13.526347 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-04a71443-d707-41ec-9276-680926d76b50 req-82bb79cf-9e6a-449e-806f-e8a750640062 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Processing event network-vif-plugged-6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:10:13.588363 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:10:13.589909 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:10:13.590122 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e644873b-9046-4305-bda6-e6b01555c047] VM Started (Lifecycle Event) Jan 26 19:10:13.595160 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:10:13.606590 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: e644873b-9046-4305-bda6-e6b01555c047] Instance spawned successfully. Jan 26 19:10:13.607756 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:10:13.779170 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:13.781323 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:13.785882 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:13.787871 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:14.102221 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e644873b-9046-4305-bda6-e6b01555c047] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:10:14.111841 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e644873b-9046-4305-bda6-e6b01555c047] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:10:14.125676 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:14.126528 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:14.126980 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:14.127207 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:14.127474 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:14.127752 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:14.618074 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e644873b-9046-4305-bda6-e6b01555c047] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:10:14.618074 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:10:14.618074 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e644873b-9046-4305-bda6-e6b01555c047] VM Paused (Lifecycle Event) Jan 26 19:10:14.636172 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Took 7.05 seconds to spawn the instance on the hypervisor. Jan 26 19:10:14.636587 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:10:14.842593 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:10:14.842680 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] VM Stopped (Lifecycle Event) Jan 26 19:10:15.122915 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e644873b-9046-4305-bda6-e6b01555c047] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:10:15.128555 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:10:15.128879 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e644873b-9046-4305-bda6-e6b01555c047] VM Resumed (Lifecycle Event) Jan 26 19:10:15.153320 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Took 18.25 seconds to build instance. Jan 26 19:10:15.347152 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3e615bd9-2f77-460f-925b-f62a61eb9057 None None] [instance: b7bca13f-0122-4185-997c-70b18dc019f6] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:10:15.585526 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6e147f3f-e1d6-4e51-ad61-ed68e6f275eb req-0a15a989-6c71-4aa8-9b47-7ed4887b9cdb service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Received event network-vif-plugged-6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:15.585735 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6e147f3f-e1d6-4e51-ad61-ed68e6f275eb req-0a15a989-6c71-4aa8-9b47-7ed4887b9cdb service nova] Acquiring lock "e644873b-9046-4305-bda6-e6b01555c047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:15.586056 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6e147f3f-e1d6-4e51-ad61-ed68e6f275eb req-0a15a989-6c71-4aa8-9b47-7ed4887b9cdb service nova] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:15.586056 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6e147f3f-e1d6-4e51-ad61-ed68e6f275eb req-0a15a989-6c71-4aa8-9b47-7ed4887b9cdb service nova] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:15.586241 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6e147f3f-e1d6-4e51-ad61-ed68e6f275eb req-0a15a989-6c71-4aa8-9b47-7ed4887b9cdb service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] No waiting events found dispatching network-vif-plugged-6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:10:15.586375 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-6e147f3f-e1d6-4e51-ad61-ed68e6f275eb req-0a15a989-6c71-4aa8-9b47-7ed4887b9cdb service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Received unexpected event network-vif-plugged-6f62e7be-24d4-4385-85c3-ad547148947c for instance with vm_state active and task_state None. Jan 26 19:10:15.633761 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e644873b-9046-4305-bda6-e6b01555c047] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:10:15.637997 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e644873b-9046-4305-bda6-e6b01555c047] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:10:15.656392 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c9a9044d-3c50-4cd7-86ef-6e172d1fbadd tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "e644873b-9046-4305-bda6-e6b01555c047" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.768s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:15.712328 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:15.712553 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:15.901974 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:16.217162 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:10:16.774856 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-2d104531-2705-45af-9c94-7d18a8b23d46 req-982fcc8a-3e2f-40df-93b3-cbb7f913b4c8 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Received event network-changed-6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:16.775023 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-2d104531-2705-45af-9c94-7d18a8b23d46 req-982fcc8a-3e2f-40df-93b3-cbb7f913b4c8 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Refreshing instance network info cache due to event network-changed-6f62e7be-24d4-4385-85c3-ad547148947c. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:10:16.775205 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2d104531-2705-45af-9c94-7d18a8b23d46 req-982fcc8a-3e2f-40df-93b3-cbb7f913b4c8 service nova] Acquiring lock "refresh_cache-e644873b-9046-4305-bda6-e6b01555c047" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:10:16.775323 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2d104531-2705-45af-9c94-7d18a8b23d46 req-982fcc8a-3e2f-40df-93b3-cbb7f913b4c8 service nova] Acquired lock "refresh_cache-e644873b-9046-4305-bda6-e6b01555c047" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:10:16.775484 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-2d104531-2705-45af-9c94-7d18a8b23d46 req-982fcc8a-3e2f-40df-93b3-cbb7f913b4c8 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Refreshing network info cache for port 6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:10:16.802434 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:16.802716 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:16.807640 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:10:16.808048 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Claim successful on node np0005596550.novalocal Jan 26 19:10:16.895455 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:10:16.895745 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:10:17.188717 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:17.278800 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-2d104531-2705-45af-9c94-7d18a8b23d46 req-982fcc8a-3e2f-40df-93b3-cbb7f913b4c8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:17.402040 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:17.665103 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-2d104531-2705-45af-9c94-7d18a8b23d46 req-982fcc8a-3e2f-40df-93b3-cbb7f913b4c8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:17.817672 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-2d104531-2705-45af-9c94-7d18a8b23d46 req-982fcc8a-3e2f-40df-93b3-cbb7f913b4c8 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Updated VIF entry in instance network info cache for port 6f62e7be-24d4-4385-85c3-ad547148947c. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:10:17.818070 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-2d104531-2705-45af-9c94-7d18a8b23d46 req-982fcc8a-3e2f-40df-93b3-cbb7f913b4c8 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Updating instance_info_cache with network_info: [{"id": "6f62e7be-24d4-4385-85c3-ad547148947c", "address": "fa:16:3e:34:84:25", "network": {"id": "d63f3398-d114-48c7-9a53-9b0dff093c9d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833956753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "159fa4c355834fd99ccce809dd17e5fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f62e7be-24", "ovs_interfaceid": "6f62e7be-24d4-4385-85c3-ad547148947c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:10:17.994009 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:10:18.328417 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2d104531-2705-45af-9c94-7d18a8b23d46 req-982fcc8a-3e2f-40df-93b3-cbb7f913b4c8 service nova] Releasing lock "refresh_cache-e644873b-9046-4305-bda6-e6b01555c047" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:10:18.474688 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:18.497526 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:10:19.008979 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.206s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:19.009517 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:10:19.012704 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.611s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:19.012939 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:19.013138 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:10:19.521654 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:10:19.522181 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:10:19.522407 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:19.522701 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:19.640583 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12364a81a9ea43658a098cdfdb50e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fd2a7189d04227bf250a5dcfbc5d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:10:20.022340 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:10:20.053819 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d204b32-9530-4994-9cf3-be570ab5f3fc/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:20.149419 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d204b32-9530-4994-9cf3-be570ab5f3fc/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:20.149815 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d204b32-9530-4994-9cf3-be570ab5f3fc/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:20.213945 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d204b32-9530-4994-9cf3-be570ab5f3fc/disk --force-share --output=json" returned: 0 in 0.064s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:20.217323 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] skipping disk /dev/sda (vda) as it is a volume {{(pid=189076) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12209}} Jan 26 19:10:20.289122 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:10:20.289955 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:20.305511 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.015s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:20.305781 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=7555MB free_disk=373.2438430786133GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:10:20.305919 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:20.306153 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:20.388311 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Successfully created port: cb0921c2-d1eb-42e1-a817-dbb8e6c542d2 {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:10:20.528375 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:10:20.904004 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:21.117001 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Successfully updated port: cb0921c2-d1eb-42e1-a817-dbb8e6c542d2 {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:10:21.168180 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-2b9d51eb-cd5a-4d91-bdf9-62b95d1e9f7f req-f7e71914-2374-4f50-8aca-f47af0a4a3a1 service nova] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Received event network-changed-cb0921c2-d1eb-42e1-a817-dbb8e6c542d2 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:21.168578 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-2b9d51eb-cd5a-4d91-bdf9-62b95d1e9f7f req-f7e71914-2374-4f50-8aca-f47af0a4a3a1 service nova] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Refreshing instance network info cache due to event network-changed-cb0921c2-d1eb-42e1-a817-dbb8e6c542d2. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:10:21.169094 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2b9d51eb-cd5a-4d91-bdf9-62b95d1e9f7f req-f7e71914-2374-4f50-8aca-f47af0a4a3a1 service nova] Acquiring lock "refresh_cache-3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:10:21.169364 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2b9d51eb-cd5a-4d91-bdf9-62b95d1e9f7f req-f7e71914-2374-4f50-8aca-f47af0a4a3a1 service nova] Acquired lock "refresh_cache-3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:10:21.169877 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-2b9d51eb-cd5a-4d91-bdf9-62b95d1e9f7f req-f7e71914-2374-4f50-8aca-f47af0a4a3a1 service nova] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Refreshing network info cache for port cb0921c2-d1eb-42e1-a817-dbb8e6c542d2 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:10:21.381281 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 9d204b32-9530-4994-9cf3-be570ab5f3fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:10:21.381399 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance e644873b-9046-4305-bda6-e6b01555c047 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:10:21.381508 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:10:21.381683 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 3 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:10:21.381859 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=1088MB phys_disk=399GB used_disk=2GB total_vcpus=8 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:10:20 up 38 min, 13 users, load average: 5.64, 5.44, 4.19\n', 'num_instances': '3', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '3', 'num_proj_06fd2a7189d04227bf250a5dcfbc5d96': '2', 'io_workload': '1', 'num_proj_159fa4c355834fd99ccce809dd17e5fd': '1', 'num_vm_building': '1', 'num_task_networking': '1'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:10:21.491901 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:10:21.541407 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:10:21.542550 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:10:21.542906 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Creating image(s) Jan 26 19:10:21.543357 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:21.543542 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "/opt/stack/data/nova/instances/3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:21.544221 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "/opt/stack/data/nova/instances/3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:21.544723 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:10:21.547602 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:10:21.548806 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:21.623176 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "refresh_cache-3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:10:21.633704 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.085s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:21.634174 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:21.634701 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:21.635737 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:10:21.639258 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:10:21.639685 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:21.674616 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-2b9d51eb-cd5a-4d91-bdf9-62b95d1e9f7f req-f7e71914-2374-4f50-8aca-f47af0a4a3a1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:21.724447 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.084s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:21.724884 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:21.796116 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-2b9d51eb-cd5a-4d91-bdf9-62b95d1e9f7f req-f7e71914-2374-4f50-8aca-f47af0a4a3a1 service nova] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:10:21.817552 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9/disk 1073741824" returned: 0 in 0.092s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:21.818017 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.183s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:21.818392 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:21.925479 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.107s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:21.926026 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:10:21.926591 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:21.994134 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-2b9d51eb-cd5a-4d91-bdf9-62b95d1e9f7f req-f7e71914-2374-4f50-8aca-f47af0a4a3a1 service nova] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:10:21.996905 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:10:22.018582 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:22.018972 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Cannot resize image /opt/stack/data/nova/instances/3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:10:22.019416 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:10:22.019632 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Ensure instance console log exists: /opt/stack/data/nova/instances/3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:10:22.020562 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:22.020727 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:22.020966 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:22.230236 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:22.513210 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2b9d51eb-cd5a-4d91-bdf9-62b95d1e9f7f req-f7e71914-2374-4f50-8aca-f47af0a4a3a1 service nova] Releasing lock "refresh_cache-3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:10:22.515746 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:10:22.515746 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.209s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:22.517562 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquired lock "refresh_cache-3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:10:22.518066 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:10:23.122170 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:10:23.122511 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] VM Stopped (Lifecycle Event) Jan 26 19:10:23.131710 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:10:23.284137 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:23.423940 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Updating instance_info_cache with network_info: [{"id": "cb0921c2-d1eb-42e1-a817-dbb8e6c542d2", "address": "fa:16:3e:09:50:5f", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0921c2-d1", "ovs_interfaceid": "cb0921c2-d1eb-42e1-a817-dbb8e6c542d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:10:23.519717 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:10:23.519946 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:10:23.520132 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:10:23.637203 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ec6d2baf-16b5-4aa2-aea0-af931a557b5a None None] [instance: 459cac8e-7df6-4a91-940f-fea48ca87f18] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:10:23.931014 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Releasing lock "refresh_cache-3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:10:23.931524 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Instance network_info: |[{"id": "cb0921c2-d1eb-42e1-a817-dbb8e6c542d2", "address": "fa:16:3e:09:50:5f", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0921c2-d1", "ovs_interfaceid": "cb0921c2-d1eb-42e1-a817-dbb8e6c542d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:10:23.935643 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Start _get_guest_xml network_info=[{"id": "cb0921c2-d1eb-42e1-a817-dbb8e6c542d2", "address": "fa:16:3e:09:50:5f", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0921c2-d1", "ovs_interfaceid": "cb0921c2-d1eb-42e1-a817-dbb8e6c542d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:10:23.941957 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:10:23.945333 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServersTestJSON-server-859272059', uuid='3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9'), owner=OwnerMeta(userid='12364a81a9ea43658a098cdfdb50e3e3', username='tempest-ServersTestJSON-1441848345-project-member', projectid='06fd2a7189d04227bf250a5dcfbc5d96', projectname='tempest-ServersTestJSON-1441848345'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cb0921c2-d1eb-42e1-a817-dbb8e6c542d2", "address": "fa:16:3e:09:50:5f", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0921c2-d1", "ovs_interfaceid": "cb0921c2-d1eb-42e1-a817-dbb8e6c542d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472623.9442062) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:10:23.947581 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:10:23.948308 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:10:23.951949 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:10:23.952597 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:10:23.954246 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:10:23.954935 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:10:23.955289 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:10:23.955593 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:10:23.955974 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:10:23.956277 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:10:23.956566 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:10:23.957143 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:10:23.957526 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:10:23.957876 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:10:23.958139 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:10:23.958483 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:10:23.963921 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:10:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersTestJSON-server-859272059',display_name='tempest-ServersTestJSON-server-859272059',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstestjson-server-859272059',id=83,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06fd2a7189d04227bf250a5dcfbc5d96',ramdisk_id='',reservation_id='r-d8y1hn62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersTestJSON-1441848345',owner_user_name='tempest-ServersTestJSON-1441848345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:10:20Z,user_data=None,user_id='12364a81a9ea43658a098cdfdb50e3e3',uuid=3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb0921c2-d1eb-42e1-a817-dbb8e6c542d2", "address": "fa:16:3e:09:50:5f", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0921c2-d1", "ovs_interfaceid": "cb0921c2-d1eb-42e1-a817-dbb8e6c542d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:10:23.964319 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converting VIF {"id": "cb0921c2-d1eb-42e1-a817-dbb8e6c542d2", "address": "fa:16:3e:09:50:5f", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0921c2-d1", "ovs_interfaceid": "cb0921c2-d1eb-42e1-a817-dbb8e6c542d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:10:23.965349 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:50:5f,bridge_name='br-int',has_traffic_filtering=True,id=cb0921c2-d1eb-42e1-a817-dbb8e6c542d2,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0921c2-d1') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:10:23.966352 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] End _get_guest_xml xml= Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9 Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: instance-00000053 Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: tempest-ServersTestJSON-server-859272059 Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:10:23 Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: tempest-ServersTestJSON-1441848345-project-member Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: tempest-ServersTestJSON-1441848345 Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9 Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9 Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:24.472490 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:10:24.475639 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Preparing to wait for external event network-vif-plugged-cb0921c2-d1eb-42e1-a817-dbb8e6c542d2 {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:10:24.475639 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:24.475639 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:24.475639 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:24.475639 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:10:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersTestJSON-server-859272059',display_name='tempest-ServersTestJSON-server-859272059',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstestjson-server-859272059',id=83,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06fd2a7189d04227bf250a5dcfbc5d96',ramdisk_id='',reservation_id='r-d8y1hn62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersTestJSON-1441848345',owner_user_name='tempest-ServersTestJSON-1441848345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:10:20Z,user_data=None,user_id='12364a81a9ea43658a098cdfdb50e3e3',uuid=3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb0921c2-d1eb-42e1-a817-dbb8e6c542d2", "address": "fa:16:3e:09:50:5f", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0921c2-d1", "ovs_interfaceid": "cb0921c2-d1eb-42e1-a817-dbb8e6c542d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:10:24.476025 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converting VIF {"id": "cb0921c2-d1eb-42e1-a817-dbb8e6c542d2", "address": "fa:16:3e:09:50:5f", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0921c2-d1", "ovs_interfaceid": "cb0921c2-d1eb-42e1-a817-dbb8e6c542d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:10:24.476640 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:50:5f,bridge_name='br-int',has_traffic_filtering=True,id=cb0921c2-d1eb-42e1-a817-dbb8e6c542d2,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0921c2-d1') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:10:24.477101 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:50:5f,bridge_name='br-int',has_traffic_filtering=True,id=cb0921c2-d1eb-42e1-a817-dbb8e6c542d2,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0921c2-d1') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:10:24.477633 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:24.478087 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:24.478479 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:10:24.479552 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:24.479906 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66c62a7a-82c6-5600-8146-00cf07e5a476', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:24.481556 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:24.483935 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:24.487064 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:24.487334 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb0921c2-d1, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:24.487832 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb0921c2-d1, col_values=(('qos', UUID('95af9545-71c5-46a1-b7b3-566fc798ec08')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:24.488134 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb0921c2-d1, col_values=(('external_ids', {'iface-id': 'cb0921c2-d1eb-42e1-a817-dbb8e6c542d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:50:5f', 'vm-uuid': '3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:24.489396 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:24.494801 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:10:24.504065 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:24.505253 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:50:5f,bridge_name='br-int',has_traffic_filtering=True,id=cb0921c2-d1eb-42e1-a817-dbb8e6c542d2,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0921c2-d1') Jan 26 19:10:24.892107 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:10:24.895788 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:10:25.896165 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:10:25.896165 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:10:26.031263 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:10:26.031501 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:10:26.031749 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] No VIF found with MAC fa:16:3e:09:50:5f, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:10:26.032559 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Using config drive Jan 26 19:10:26.542186 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:26.660608 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Creating config drive at /opt/stack/data/nova/instances/3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9/disk.config Jan 26 19:10:26.665689 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpxte58vs7 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:26.791396 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpxte58vs7" returned: 0 in 0.125s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:26.921263 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:26.925622 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:27.067241 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:27.068903 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:27.084180 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:10:27.086070 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] VM Started (Lifecycle Event) Jan 26 19:10:27.107391 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-04883e27-0bb5-4c53-86cc-4dfe79fa44d8 req-08adbb3f-c9ea-47e3-a352-90a5d7704ff8 service nova] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Received event network-vif-plugged-cb0921c2-d1eb-42e1-a817-dbb8e6c542d2 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:27.107620 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-04883e27-0bb5-4c53-86cc-4dfe79fa44d8 req-08adbb3f-c9ea-47e3-a352-90a5d7704ff8 service nova] Acquiring lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:27.109333 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-04883e27-0bb5-4c53-86cc-4dfe79fa44d8 req-08adbb3f-c9ea-47e3-a352-90a5d7704ff8 service nova] Lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:27.109571 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-04883e27-0bb5-4c53-86cc-4dfe79fa44d8 req-08adbb3f-c9ea-47e3-a352-90a5d7704ff8 service nova] Lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:27.110098 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-04883e27-0bb5-4c53-86cc-4dfe79fa44d8 req-08adbb3f-c9ea-47e3-a352-90a5d7704ff8 service nova] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Processing event network-vif-plugged-cb0921c2-d1eb-42e1-a817-dbb8e6c542d2 {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:10:27.112118 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:10:27.118871 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:10:27.123465 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Instance spawned successfully. Jan 26 19:10:27.123837 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:10:27.233604 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:27.593140 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:10:27.598425 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:10:27.636697 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:27.636929 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:27.637396 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:27.637724 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:27.640359 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:27.640856 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:28.102497 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:10:28.103171 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:10:28.103336 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] VM Paused (Lifecycle Event) Jan 26 19:10:28.148440 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Took 6.61 seconds to spawn the instance on the hypervisor. Jan 26 19:10:28.148839 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:10:28.610849 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:10:28.616445 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:10:28.616879 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] VM Resumed (Lifecycle Event) Jan 26 19:10:28.663978 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Took 11.94 seconds to build instance. Jan 26 19:10:29.121615 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:10:29.124692 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:10:29.139129 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c97ca2d0-70a0-4ce0-968a-c54524e90032 req-df7e1ca0-406b-46b3-bb1d-aa40990653d2 service nova] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Received event network-vif-plugged-cb0921c2-d1eb-42e1-a817-dbb8e6c542d2 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:29.139300 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c97ca2d0-70a0-4ce0-968a-c54524e90032 req-df7e1ca0-406b-46b3-bb1d-aa40990653d2 service nova] Acquiring lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:29.139512 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c97ca2d0-70a0-4ce0-968a-c54524e90032 req-df7e1ca0-406b-46b3-bb1d-aa40990653d2 service nova] Lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:29.139680 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c97ca2d0-70a0-4ce0-968a-c54524e90032 req-df7e1ca0-406b-46b3-bb1d-aa40990653d2 service nova] Lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:29.142670 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c97ca2d0-70a0-4ce0-968a-c54524e90032 req-df7e1ca0-406b-46b3-bb1d-aa40990653d2 service nova] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] No waiting events found dispatching network-vif-plugged-cb0921c2-d1eb-42e1-a817-dbb8e6c542d2 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:10:29.142920 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-c97ca2d0-70a0-4ce0-968a-c54524e90032 req-df7e1ca0-406b-46b3-bb1d-aa40990653d2 service nova] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Received unexpected event network-vif-plugged-cb0921c2-d1eb-42e1-a817-dbb8e6c542d2 for instance with vm_state active and task_state deleting. Jan 26 19:10:29.166244 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-eac28ded-0c12-45ac-bf2a-25cc8b152781 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 13.453s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:29.393102 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:29.393249 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:29.393461 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:29.393646 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:29.393819 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:29.396678 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Terminating instance Jan 26 19:10:29.489453 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:29.628245 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] During sync_power_state the instance has a pending task (deleting). Skip. Jan 26 19:10:29.900067 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:10:29.935808 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:30.115709 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:30.127075 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:30.195321 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Instance destroyed successfully. Jan 26 19:10:30.195953 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lazy-loading 'resources' on Instance uuid 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:10:30.700367 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] vif_type=ovs instance=Instance(access_ip_v4=1.1.1.1,access_ip_v6=::babe:202:202,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:10:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServersTestJSON-server-859272059',display_name='tempest-ServersTestJSON-server-859272059',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstestjson-server-859272059',id=83,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:10:28Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='06fd2a7189d04227bf250a5dcfbc5d96',ramdisk_id='',reservation_id='r-d8y1hn62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersTestJSON-1441848345',owner_user_name='tempest-ServersTestJSON-1441848345-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:10:28Z,user_data=None,user_id='12364a81a9ea43658a098cdfdb50e3e3',uuid=3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb0921c2-d1eb-42e1-a817-dbb8e6c542d2", "address": "fa:16:3e:09:50:5f", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0921c2-d1", "ovs_interfaceid": "cb0921c2-d1eb-42e1-a817-dbb8e6c542d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:10:30.700672 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converting VIF {"id": "cb0921c2-d1eb-42e1-a817-dbb8e6c542d2", "address": "fa:16:3e:09:50:5f", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0921c2-d1", "ovs_interfaceid": "cb0921c2-d1eb-42e1-a817-dbb8e6c542d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:10:30.703150 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:50:5f,bridge_name='br-int',has_traffic_filtering=True,id=cb0921c2-d1eb-42e1-a817-dbb8e6c542d2,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0921c2-d1') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:10:30.703502 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:50:5f,bridge_name='br-int',has_traffic_filtering=True,id=cb0921c2-d1eb-42e1-a817-dbb8e6c542d2,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0921c2-d1') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:10:30.704942 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:30.705278 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb0921c2-d1, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:30.748314 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:30.752973 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:30.754743 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:30.755060 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95af9545-71c5-46a1-b7b3-566fc798ec08) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:30.757429 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:30.759631 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:10:30.762055 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:50:5f,bridge_name='br-int',has_traffic_filtering=True,id=cb0921c2-d1eb-42e1-a817-dbb8e6c542d2,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0921c2-d1') Jan 26 19:10:30.762531 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Deleting instance files /opt/stack/data/nova/instances/3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9_del Jan 26 19:10:30.763165 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Deletion of /opt/stack/data/nova/instances/3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9_del complete Jan 26 19:10:31.198589 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-2e359320-35c6-4390-bdde-0a63c29b636b req-eff21e40-99fd-490c-9c79-b8504bffb7fe service nova] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Received event network-vif-unplugged-cb0921c2-d1eb-42e1-a817-dbb8e6c542d2 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:31.199165 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2e359320-35c6-4390-bdde-0a63c29b636b req-eff21e40-99fd-490c-9c79-b8504bffb7fe service nova] Acquiring lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:31.199523 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2e359320-35c6-4390-bdde-0a63c29b636b req-eff21e40-99fd-490c-9c79-b8504bffb7fe service nova] Lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:31.200080 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2e359320-35c6-4390-bdde-0a63c29b636b req-eff21e40-99fd-490c-9c79-b8504bffb7fe service nova] Lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:31.200446 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-2e359320-35c6-4390-bdde-0a63c29b636b req-eff21e40-99fd-490c-9c79-b8504bffb7fe service nova] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] No waiting events found dispatching network-vif-unplugged-cb0921c2-d1eb-42e1-a817-dbb8e6c542d2 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:10:31.200777 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-2e359320-35c6-4390-bdde-0a63c29b636b req-eff21e40-99fd-490c-9c79-b8504bffb7fe service nova] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Received event network-vif-unplugged-cb0921c2-d1eb-42e1-a817-dbb8e6c542d2 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:10:31.201162 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-2e359320-35c6-4390-bdde-0a63c29b636b req-eff21e40-99fd-490c-9c79-b8504bffb7fe service nova] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Received event network-vif-unplugged-cb0921c2-d1eb-42e1-a817-dbb8e6c542d2 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:31.201806 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2e359320-35c6-4390-bdde-0a63c29b636b req-eff21e40-99fd-490c-9c79-b8504bffb7fe service nova] Acquiring lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:31.201806 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2e359320-35c6-4390-bdde-0a63c29b636b req-eff21e40-99fd-490c-9c79-b8504bffb7fe service nova] Lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:31.202042 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2e359320-35c6-4390-bdde-0a63c29b636b req-eff21e40-99fd-490c-9c79-b8504bffb7fe service nova] Lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:31.202328 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-2e359320-35c6-4390-bdde-0a63c29b636b req-eff21e40-99fd-490c-9c79-b8504bffb7fe service nova] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] No waiting events found dispatching network-vif-unplugged-cb0921c2-d1eb-42e1-a817-dbb8e6c542d2 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:10:31.202608 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-2e359320-35c6-4390-bdde-0a63c29b636b req-eff21e40-99fd-490c-9c79-b8504bffb7fe service nova] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Received event network-vif-unplugged-cb0921c2-d1eb-42e1-a817-dbb8e6c542d2 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:10:31.272032 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Took 1.37 seconds to destroy the instance on the hypervisor. Jan 26 19:10:31.272501 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:10:31.273084 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:10:31.273386 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:10:31.273966 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:31.412785 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:32.205415 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:10:32.235069 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:32.709575 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Took 1.44 seconds to deallocate network for instance. Jan 26 19:10:33.219590 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:33.220118 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:33.252713 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-efb61210-c03e-4a57-be75-1d61f1ee8c87 req-1a5b1f71-8a2b-4b8c-a74b-e05facdaecbd service nova] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Received event network-vif-deleted-cb0921c2-d1eb-42e1-a817-dbb8e6c542d2 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:33.397436 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:10:33.902325 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:10:34.407593 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.188s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:34.466473 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Deleted allocations for instance 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9 Jan 26 19:10:35.306032 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:35.475707 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c83858bb-4708-453a-95ad-32ea63b076b3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.082s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:35.756269 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:37.089554 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:37.090514 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:37.240103 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:37.240103 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:37.596550 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:10:38.157709 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:38.158136 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:38.167361 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:10:38.167582 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Claim successful on node np0005596550.novalocal Jan 26 19:10:39.333236 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:10:39.837898 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:10:40.030387 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:40.030659 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:40.344955 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.187s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:40.345511 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:10:40.534651 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:10:40.757677 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:40.853562 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:10:40.853873 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:10:40.854374 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:40.855049 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:40.958642 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12364a81a9ea43658a098cdfdb50e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fd2a7189d04227bf250a5dcfbc5d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:10:41.089125 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:41.089546 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:41.094595 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:10:41.094915 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Claim successful on node np0005596550.novalocal Jan 26 19:10:41.359104 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:10:41.458294 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Successfully created port: a358cff6-23db-41f5-abae-f01e3b72b301 {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:10:41.862744 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:10:41.955011 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Successfully updated port: a358cff6-23db-41f5-abae-f01e3b72b301 {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:10:41.995466 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-1c169581-1dc9-405a-8654-df08ba29bf87 req-9d9b7871-c6c7-41e5-82aa-7059c1dd0075 service nova] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Received event network-changed-a358cff6-23db-41f5-abae-f01e3b72b301 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:41.995528 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-1c169581-1dc9-405a-8654-df08ba29bf87 req-9d9b7871-c6c7-41e5-82aa-7059c1dd0075 service nova] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Refreshing instance network info cache due to event network-changed-a358cff6-23db-41f5-abae-f01e3b72b301. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:10:41.996197 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1c169581-1dc9-405a-8654-df08ba29bf87 req-9d9b7871-c6c7-41e5-82aa-7059c1dd0075 service nova] Acquiring lock "refresh_cache-485e04ea-4ea2-4b13-83c3-71ab6c3531e3" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:10:41.996197 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1c169581-1dc9-405a-8654-df08ba29bf87 req-9d9b7871-c6c7-41e5-82aa-7059c1dd0075 service nova] Acquired lock "refresh_cache-485e04ea-4ea2-4b13-83c3-71ab6c3531e3" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:10:41.996197 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-1c169581-1dc9-405a-8654-df08ba29bf87 req-9d9b7871-c6c7-41e5-82aa-7059c1dd0075 service nova] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Refreshing network info cache for port a358cff6-23db-41f5-abae-f01e3b72b301 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:10:42.252093 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:42.273741 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:10:42.460346 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "refresh_cache-485e04ea-4ea2-4b13-83c3-71ab6c3531e3" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:10:42.498366 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-1c169581-1dc9-405a-8654-df08ba29bf87 req-9d9b7871-c6c7-41e5-82aa-7059c1dd0075 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:42.560091 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-1c169581-1dc9-405a-8654-df08ba29bf87 req-9d9b7871-c6c7-41e5-82aa-7059c1dd0075 service nova] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:10:42.744525 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-1c169581-1dc9-405a-8654-df08ba29bf87 req-9d9b7871-c6c7-41e5-82aa-7059c1dd0075 service nova] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:10:42.777943 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:10:42.877171 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:10:42.878207 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:10:42.878537 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Creating image(s) Jan 26 19:10:42.879045 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "/opt/stack/data/nova/instances/485e04ea-4ea2-4b13-83c3-71ab6c3531e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:42.879278 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "/opt/stack/data/nova/instances/485e04ea-4ea2-4b13-83c3-71ab6c3531e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:42.880043 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "/opt/stack/data/nova/instances/485e04ea-4ea2-4b13-83c3-71ab6c3531e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:42.880655 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:10:42.884897 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:10:42.886331 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:42.978683 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.092s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:42.979045 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:42.979570 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:42.980143 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:10:42.984515 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:10:42.985000 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:43.052012 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.067s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:43.052285 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/485e04ea-4ea2-4b13-83c3-71ab6c3531e3/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:43.089730 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/485e04ea-4ea2-4b13-83c3-71ab6c3531e3/disk 1073741824" returned: 0 in 0.037s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:43.090105 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.111s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:43.090427 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:43.165438 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.074s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:43.165840 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Checking if we can resize image /opt/stack/data/nova/instances/485e04ea-4ea2-4b13-83c3-71ab6c3531e3/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:10:43.166304 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/485e04ea-4ea2-4b13-83c3-71ab6c3531e3/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:43.247254 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/485e04ea-4ea2-4b13-83c3-71ab6c3531e3/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:43.248146 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1c169581-1dc9-405a-8654-df08ba29bf87 req-9d9b7871-c6c7-41e5-82aa-7059c1dd0075 service nova] Releasing lock "refresh_cache-485e04ea-4ea2-4b13-83c3-71ab6c3531e3" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:10:43.250804 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Cannot resize image /opt/stack/data/nova/instances/485e04ea-4ea2-4b13-83c3-71ab6c3531e3/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:10:43.250804 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:10:43.250804 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Ensure instance console log exists: /opt/stack/data/nova/instances/485e04ea-4ea2-4b13-83c3-71ab6c3531e3/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:10:43.250804 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:43.250804 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:43.250804 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:43.251101 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquired lock "refresh_cache-485e04ea-4ea2-4b13-83c3-71ab6c3531e3" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:10:43.251326 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:10:43.289578 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.200s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:43.290366 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:10:43.804634 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:10:43.805185 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:10:43.805375 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:43.805706 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:43.830458 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:10:43.888723 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6cbe3740f6c4303bbf3e5d5c92677db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261cb1c98c954302ba86efa2ceee43f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:10:43.960382 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:44.098797 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Updating instance_info_cache with network_info: [{"id": "a358cff6-23db-41f5-abae-f01e3b72b301", "address": "fa:16:3e:a9:ad:b4", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa358cff6-23", "ovs_interfaceid": "a358cff6-23db-41f5-abae-f01e3b72b301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:10:44.326318 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:10:44.329505 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Successfully created port: 4841e3d0-589b-4d89-9700-763060784597 {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:10:44.601711 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Releasing lock "refresh_cache-485e04ea-4ea2-4b13-83c3-71ab6c3531e3" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:10:44.602319 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Instance network_info: |[{"id": "a358cff6-23db-41f5-abae-f01e3b72b301", "address": "fa:16:3e:a9:ad:b4", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa358cff6-23", "ovs_interfaceid": "a358cff6-23db-41f5-abae-f01e3b72b301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:10:44.605860 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Start _get_guest_xml network_info=[{"id": "a358cff6-23db-41f5-abae-f01e3b72b301", "address": "fa:16:3e:a9:ad:b4", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa358cff6-23", "ovs_interfaceid": "a358cff6-23db-41f5-abae-f01e3b72b301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:10:44.610811 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:10:44.612383 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServersTestJSON-server-1199990724', uuid='485e04ea-4ea2-4b13-83c3-71ab6c3531e3'), owner=OwnerMeta(userid='12364a81a9ea43658a098cdfdb50e3e3', username='tempest-ServersTestJSON-1441848345-project-member', projectid='06fd2a7189d04227bf250a5dcfbc5d96', projectname='tempest-ServersTestJSON-1441848345'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a358cff6-23db-41f5-abae-f01e3b72b301", "address": "fa:16:3e:a9:ad:b4", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa358cff6-23", "ovs_interfaceid": "a358cff6-23db-41f5-abae-f01e3b72b301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472644.6118424) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:10:44.615941 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:10:44.615941 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:10:44.617472 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:10:44.618104 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:10:44.618356 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:10:44.618643 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:10:44.618886 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:10:44.618949 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:10:44.619094 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:10:44.619208 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:10:44.619330 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:10:44.619499 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:10:44.619628 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:10:44.619759 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:10:44.619902 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:10:44.620044 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:10:44.623067 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:10:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersTestJSON-server-1199990724',display_name='tempest-ServersTestJSON-server-1199990724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstestjson-server-1199990724',id=84,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06fd2a7189d04227bf250a5dcfbc5d96',ramdisk_id='',reservation_id='r-laquilwj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersTestJSON-1441848345',owner_user_name='tempest-ServersTestJSON-1441848345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:10:41Z,user_data=None,user_id='12364a81a9ea43658a098cdfdb50e3e3',uuid=485e04ea-4ea2-4b13-83c3-71ab6c3531e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a358cff6-23db-41f5-abae-f01e3b72b301", "address": "fa:16:3e:a9:ad:b4", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa358cff6-23", "ovs_interfaceid": "a358cff6-23db-41f5-abae-f01e3b72b301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:10:44.623067 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converting VIF {"id": "a358cff6-23db-41f5-abae-f01e3b72b301", "address": "fa:16:3e:a9:ad:b4", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa358cff6-23", "ovs_interfaceid": "a358cff6-23db-41f5-abae-f01e3b72b301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:10:44.623205 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ad:b4,bridge_name='br-int',has_traffic_filtering=True,id=a358cff6-23db-41f5-abae-f01e3b72b301,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa358cff6-23') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:10:44.623571 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lazy-loading 'pci_devices' on Instance uuid 485e04ea-4ea2-4b13-83c3-71ab6c3531e3 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:10:44.833519 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:10:44.867100 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Successfully updated port: 4841e3d0-589b-4d89-9700-763060784597 {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:10:44.874811 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Rebuilding instance Jan 26 19:10:44.917360 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a55b8dea-aaaa-4a48-aab3-d146bcbaf82b req-6cb08738-fa07-4c77-8ef2-35bd58b4a1d6 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Received event network-changed-4841e3d0-589b-4d89-9700-763060784597 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:44.917726 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a55b8dea-aaaa-4a48-aab3-d146bcbaf82b req-6cb08738-fa07-4c77-8ef2-35bd58b4a1d6 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Refreshing instance network info cache due to event network-changed-4841e3d0-589b-4d89-9700-763060784597. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:10:44.918410 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a55b8dea-aaaa-4a48-aab3-d146bcbaf82b req-6cb08738-fa07-4c77-8ef2-35bd58b4a1d6 service nova] Acquiring lock "refresh_cache-d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:10:44.918937 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a55b8dea-aaaa-4a48-aab3-d146bcbaf82b req-6cb08738-fa07-4c77-8ef2-35bd58b4a1d6 service nova] Acquired lock "refresh_cache-d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:10:44.919270 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-a55b8dea-aaaa-4a48-aab3-d146bcbaf82b req-6cb08738-fa07-4c77-8ef2-35bd58b4a1d6 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Refreshing network info cache for port 4841e3d0-589b-4d89-9700-763060784597 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:10:44.998351 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] End _get_guest_xml xml= Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3 Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: instance-00000054 Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: tempest-ServersTestJSON-server-1199990724 Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:10:44 Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: tempest-ServersTestJSON-1441848345-project-member Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: tempest-ServersTestJSON-1441848345 Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3 Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3 Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:45.126742 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:10:45.128606 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Preparing to wait for external event network-vif-plugged-a358cff6-23db-41f5-abae-f01e3b72b301 {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:10:45.128606 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:45.128606 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:45.128606 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:45.128738 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:10:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersTestJSON-server-1199990724',display_name='tempest-ServersTestJSON-server-1199990724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstestjson-server-1199990724',id=84,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06fd2a7189d04227bf250a5dcfbc5d96',ramdisk_id='',reservation_id='r-laquilwj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersTestJSON-1441848345',owner_user_name='tempest-ServersTestJSON-1441848345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:10:41Z,user_data=None,user_id='12364a81a9ea43658a098cdfdb50e3e3',uuid=485e04ea-4ea2-4b13-83c3-71ab6c3531e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a358cff6-23db-41f5-abae-f01e3b72b301", "address": "fa:16:3e:a9:ad:b4", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa358cff6-23", "ovs_interfaceid": "a358cff6-23db-41f5-abae-f01e3b72b301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:10:45.128958 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converting VIF {"id": "a358cff6-23db-41f5-abae-f01e3b72b301", "address": "fa:16:3e:a9:ad:b4", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa358cff6-23", "ovs_interfaceid": "a358cff6-23db-41f5-abae-f01e3b72b301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:10:45.129613 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ad:b4,bridge_name='br-int',has_traffic_filtering=True,id=a358cff6-23db-41f5-abae-f01e3b72b301,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa358cff6-23') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:10:45.129961 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ad:b4,bridge_name='br-int',has_traffic_filtering=True,id=a358cff6-23db-41f5-abae-f01e3b72b301,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa358cff6-23') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:10:45.130448 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:45.130935 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:45.131290 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:10:45.132111 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:45.132423 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf1088f7-51f8-5913-840f-75e5d49ea10f', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:45.133479 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:45.135153 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:45.137671 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:45.138015 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa358cff6-23, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:45.138476 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa358cff6-23, col_values=(('qos', UUID('3bafb2e9-bd3d-4d24-88ad-5b55f100d5cc')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:45.138709 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa358cff6-23, col_values=(('external_ids', {'iface-id': 'a358cff6-23db-41f5-abae-f01e3b72b301', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:ad:b4', 'vm-uuid': '485e04ea-4ea2-4b13-83c3-71ab6c3531e3'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:45.139817 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:45.143536 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:10:45.147795 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:45.148339 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ad:b4,bridge_name='br-int',has_traffic_filtering=True,id=a358cff6-23db-41f5-abae-f01e3b72b301,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa358cff6-23') Jan 26 19:10:45.191151 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:10:45.191269 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] VM Stopped (Lifecycle Event) Jan 26 19:10:45.372182 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "refresh_cache-d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:10:45.425736 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-a55b8dea-aaaa-4a48-aab3-d146bcbaf82b req-6cb08738-fa07-4c77-8ef2-35bd58b4a1d6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:45.495231 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-a55b8dea-aaaa-4a48-aab3-d146bcbaf82b req-6cb08738-fa07-4c77-8ef2-35bd58b4a1d6 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:10:45.664374 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-a55b8dea-aaaa-4a48-aab3-d146bcbaf82b req-6cb08738-fa07-4c77-8ef2-35bd58b4a1d6 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:10:45.694612 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a933731a-0801-48db-8dd0-e464c7376a8c None None] [instance: 3e3fc6b3-0fc7-4bfb-a400-8e2f048239a9] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:10:45.843232 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:10:45.844314 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:10:45.844749 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Creating image(s) Jan 26 19:10:45.845376 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:45.845573 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "/opt/stack/data/nova/instances/d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:45.846193 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "/opt/stack/data/nova/instances/d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:45.846713 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:10:45.850545 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:10:45.851949 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:45.935698 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.083s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:45.936091 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:45.936822 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:45.937283 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:10:45.940760 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:10:45.941108 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:46.008262 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.067s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:46.008806 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:46.043828 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f/disk 1073741824" returned: 0 in 0.034s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:46.043828 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.107s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:46.043828 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:46.077333 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:46.084695 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:46.105162 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:46.117910 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:46.119888 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.076s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:46.119888 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:10:46.120888 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:46.167848 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a55b8dea-aaaa-4a48-aab3-d146bcbaf82b req-6cb08738-fa07-4c77-8ef2-35bd58b4a1d6 service nova] Releasing lock "refresh_cache-d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:10:46.168299 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquired lock "refresh_cache-d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:10:46.168481 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:10:46.196073 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:46.196385 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Cannot resize image /opt/stack/data/nova/instances/d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:10:46.196673 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:10:46.197133 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Ensure instance console log exists: /opt/stack/data/nova/instances/d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:10:46.197245 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:46.197440 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:46.197607 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:46.297225 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: e644873b-9046-4305-bda6-e6b01555c047] Instance destroyed successfully. Jan 26 19:10:46.302114 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: e644873b-9046-4305-bda6-e6b01555c047] Instance destroyed successfully. Jan 26 19:10:46.302899 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:09:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1178538683',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionsv293testjson-server-1897556847',id=82,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMleCBrZBqJ3bjgXVIsALOmKVUFCcb37z9LQkq4/iqQlFLQoYPVskU6EQUtERGdJ+j9iydCEKOj11OCXZNr3wo6GhNqY2IPdqhyyzdKUIx044D+00FnIK90zBOamNJRrA==',key_name='tempest-keypair-352548147',keypairs=,launch_index=0,launched_at=2026-01-27T00:10:14Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='159fa4c355834fd99ccce809dd17e5fd',ramdisk_id='',reservation_id='r-uve25rn8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bd70f82e-84e0-4042-ad07-7b834bb8ac38',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1845614456',owner_user_name='tempest-ServerActionsV293TestJSON-1845614456-project-member'},tags=,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:10:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48586137c66f4adcbebed7d64bf6c678',uuid=e644873b-9046-4305-bda6-e6b01555c047,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f62e7be-24d4-4385-85c3-ad547148947c", "address": "fa:16:3e:34:84:25", "network": {"id": "d63f3398-d114-48c7-9a53-9b0dff093c9d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833956753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "159fa4c355834fd99ccce809dd17e5fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f62e7be-24", "ovs_interfaceid": "6f62e7be-24d4-4385-85c3-ad547148947c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:10:46.303161 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Converting VIF {"id": "6f62e7be-24d4-4385-85c3-ad547148947c", "address": "fa:16:3e:34:84:25", "network": {"id": "d63f3398-d114-48c7-9a53-9b0dff093c9d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833956753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "159fa4c355834fd99ccce809dd17e5fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f62e7be-24", "ovs_interfaceid": "6f62e7be-24d4-4385-85c3-ad547148947c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:10:46.303682 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:84:25,bridge_name='br-int',has_traffic_filtering=True,id=6f62e7be-24d4-4385-85c3-ad547148947c,network=Network(d63f3398-d114-48c7-9a53-9b0dff093c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f62e7be-24') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:10:46.303940 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:84:25,bridge_name='br-int',has_traffic_filtering=True,id=6f62e7be-24d4-4385-85c3-ad547148947c,network=Network(d63f3398-d114-48c7-9a53-9b0dff093c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f62e7be-24') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:10:46.305847 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:46.305847 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f62e7be-24, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:46.306567 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:46.310860 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:10:46.313119 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:46.314034 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:46.314215 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7502fdf-33b7-421c-96d4-18448a795206) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:46.315313 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:46.317790 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:10:46.320731 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:46.322818 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:84:25,bridge_name='br-int',has_traffic_filtering=True,id=6f62e7be-24d4-4385-85c3-ad547148947c,network=Network(d63f3398-d114-48c7-9a53-9b0dff093c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f62e7be-24') Jan 26 19:10:46.324666 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] calling os-brick to detach iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jan 26 19:10:46.325368 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'target_lun': 0, 'volume_id': '4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'auth_method': 'CHAP', 'auth_username': 'vLGbFUG9rYjACzbmVoRC', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sda'}, None), 'kwargs': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:10:46.325468 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:10:46.325831 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:10:46.326535 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:46.336584 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:46.336719 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[794686c1-e1e0-4857-9cea-a0e440ebcf13]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:46.337075 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:10:46.337075 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:10:46.337075 np0005596550.novalocal nova-compute[189076]: iSNS: Jan 26 19:10:46.337075 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:10:46.337075 np0005596550.novalocal nova-compute[189076]: STATIC: Jan 26 19:10:46.337075 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da Jan 26 19:10:46.337075 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:10:46.337075 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:10:46.337075 np0005596550.novalocal nova-compute[189076]: FIRMWARE: Jan 26 19:10:46.337075 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:10:46.337075 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:10:46.337294 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:10:46.337294 np0005596550.novalocal nova-compute[189076]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:10:46.337294 np0005596550.novalocal nova-compute[189076]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=189076) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:10:46.337501 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da', 0)] {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:10:46.338163 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:46.347272 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:46.347512 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a429705-213b-42b4-ba3d-46943467addb]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:46.350375 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:46.361058 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:46.361175 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[75de6dfc-96a1-440b-9a25-5e8195e09aef]: (4, ('tcp: [13] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:46.361505 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da (non-flash) Jan 26 19:10:46.361505 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:10:46.361646 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsi session list stdout=tcp: [13] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da (non-flash) Jan 26 19:10:46.361646 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:10:46.362197 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Resulting device map defaultdict(. at 0x7fd75024ae80>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da'): ({'sda'}, set())}) {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:10:46.362486 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Removing single pathed devices sda {{(pid=189076) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:10:46.363549 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:46.371268 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:10:46.374047 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[0666bc71-8612-479e-a03d-6deb238ba2b8]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:10:46.374047 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:10:46.374047 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:10:46.374047 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:10:46.374047 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:46.374047 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:10:46.374047 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:10:46.374047 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:46.374047 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:10:46.374047 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:10:46.374047 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:46.374047 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:10:46.374047 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:10:46.374047 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:46.374047 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:10:46.374047 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:10:46.374047 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:46.374047 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:10:46.374047 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:10:46.374047 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:10:46.374047 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:10:46.374047 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:10:46.375578 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[0666bc71-8612-479e-a03d-6deb238ba2b8]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:46.376302 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Flushing IO for device /dev/sda {{(pid=189076) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:10:46.378068 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sda {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:46.384885 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sda" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:46.385047 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8d016f-411c-4b53-8fdc-c24f6a5abd4f]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:46.385421 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Remove SCSI device /dev/sda with /sys/block/sda/device/delete {{(pid=189076) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:10:46.386240 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sda/device/delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:46.438410 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sda/device/delete" returned: 0 in 0.051s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:46.438616 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc3e49e-367b-4f25-bece-fc52e02284d1]: (4, ('1', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:46.439708 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Checking to see if SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:10:46.441383 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:10:46.441722 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da')] {{(pid=189076) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:10:46.443163 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:46.451386 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:46.451505 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[201007e6-987d-497a-aed7-3c85d4d34b45]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:46.451883 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:10:46.452656 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --logout {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:46.489937 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --logout" returned: 0 in 0.037s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:46.490102 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d010d2ed-c8a9-4165-afb2-f5123c42c5b5]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da, portal: 38.102.83.18,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:46.490456 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da, portal: 38.102.83.18,3260] Jan 26 19:10:46.490456 np0005596550.novalocal nova-compute[189076]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da, portal: 38.102.83.18,3260] successful. Jan 26 19:10:46.490456 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:10:46.491975 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:46.501012 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op delete" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:46.501163 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[2352ec39-9b88-44a4-8fcc-95cc114d6def]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:46.501420 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:10:46.501762 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.176s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:10:46.501913 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] <== disconnect_volume: return (176ms) None {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:10:46.502061 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Disconnected iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jan 26 19:10:46.502319 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Deleting instance files /opt/stack/data/nova/instances/e644873b-9046-4305-bda6-e6b01555c047_del Jan 26 19:10:46.502856 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Deletion of /opt/stack/data/nova/instances/e644873b-9046-4305-bda6-e6b01555c047_del complete Jan 26 19:10:46.715393 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:10:46.715722 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:10:46.716109 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] No VIF found with MAC fa:16:3e:a9:ad:b4, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:10:46.718678 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Using config drive Jan 26 19:10:46.746694 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:10:46.871702 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:46.947202 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-98a02ce2-a59f-4fa1-b143-5dd0fa658f2c req-dccdf546-cdf5-459f-a3e9-a7cd07f46c93 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Received event network-vif-unplugged-6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:46.948638 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-98a02ce2-a59f-4fa1-b143-5dd0fa658f2c req-dccdf546-cdf5-459f-a3e9-a7cd07f46c93 service nova] Acquiring lock "e644873b-9046-4305-bda6-e6b01555c047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:46.948905 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-98a02ce2-a59f-4fa1-b143-5dd0fa658f2c req-dccdf546-cdf5-459f-a3e9-a7cd07f46c93 service nova] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:46.948973 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-98a02ce2-a59f-4fa1-b143-5dd0fa658f2c req-dccdf546-cdf5-459f-a3e9-a7cd07f46c93 service nova] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:46.949130 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-98a02ce2-a59f-4fa1-b143-5dd0fa658f2c req-dccdf546-cdf5-459f-a3e9-a7cd07f46c93 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] No waiting events found dispatching network-vif-unplugged-6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:10:46.949310 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-98a02ce2-a59f-4fa1-b143-5dd0fa658f2c req-dccdf546-cdf5-459f-a3e9-a7cd07f46c93 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Received unexpected event network-vif-unplugged-6f62e7be-24d4-4385-85c3-ad547148947c for instance with vm_state active and task_state rebuilding. Jan 26 19:10:46.949430 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-98a02ce2-a59f-4fa1-b143-5dd0fa658f2c req-dccdf546-cdf5-459f-a3e9-a7cd07f46c93 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Received event network-vif-unplugged-6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:46.949584 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-98a02ce2-a59f-4fa1-b143-5dd0fa658f2c req-dccdf546-cdf5-459f-a3e9-a7cd07f46c93 service nova] Acquiring lock "e644873b-9046-4305-bda6-e6b01555c047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:46.949744 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-98a02ce2-a59f-4fa1-b143-5dd0fa658f2c req-dccdf546-cdf5-459f-a3e9-a7cd07f46c93 service nova] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:46.949913 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-98a02ce2-a59f-4fa1-b143-5dd0fa658f2c req-dccdf546-cdf5-459f-a3e9-a7cd07f46c93 service nova] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:46.950103 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-98a02ce2-a59f-4fa1-b143-5dd0fa658f2c req-dccdf546-cdf5-459f-a3e9-a7cd07f46c93 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] No waiting events found dispatching network-vif-unplugged-6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:10:46.950236 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-98a02ce2-a59f-4fa1-b143-5dd0fa658f2c req-dccdf546-cdf5-459f-a3e9-a7cd07f46c93 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Received unexpected event network-vif-unplugged-6f62e7be-24d4-4385-85c3-ad547148947c for instance with vm_state active and task_state rebuilding. Jan 26 19:10:46.960825 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Updating instance_info_cache with network_info: [{"id": "4841e3d0-589b-4d89-9700-763060784597", "address": "fa:16:3e:8b:fc:cc", "network": {"id": "94b85e06-699e-4d2b-a361-6a62d99d858f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1614914474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261cb1c98c954302ba86efa2ceee43f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4841e3d0-58", "ovs_interfaceid": "4841e3d0-589b-4d89-9700-763060784597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:10:47.084791 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance e644873b-9046-4305-bda6-e6b01555c047 could not be found. Jan 26 19:10:47.086225 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] calling os-brick to detach iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jan 26 19:10:47.087081 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'target_lun': 0, 'volume_id': '4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'auth_method': 'CHAP', 'auth_username': 'vLGbFUG9rYjACzbmVoRC', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sda'}, None), 'kwargs': False}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:10:47.087373 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:10:47.087830 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:10:47.088982 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:47.101379 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:47.101619 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[92070aa0-9582-435e-9b3c-dddc110a0c70]: Unexpected error while running command. Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: Command: iscsiadm -m discoverydb -o show -P 1 Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: Exit code: 21 Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n' Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: Stderr: '' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 388, in execute Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: raise ProcessExecutionError(exit_code=_returncode, Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command. Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: Command: iscsiadm -m discoverydb -o show -P 1 Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: Exit code: 21 Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n' Jan 26 19:10:47.102372 np0005596550.novalocal nova-compute[189076]: Stderr: '' Jan 26 19:10:47.102815 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[92070aa0-9582-435e-9b3c-dddc110a0c70]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 388, in execute\n raise ProcessExecutionError(exit_code=_returncode,\noslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.\nCommand: iscsiadm -m discoverydb -o show -P 1\nExit code: 21\nStdout: \'SENDTARGETS:\\nNo targets found.\\niSNS:\\nNo targets found.\\nSTATIC:\\nNo targets found.\\nFIRMWARE:\\nNo targets found.\\n\'\nStderr: \'\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command. Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: Command: iscsiadm -m discoverydb -o show -P 1 Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: Exit code: 21 Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n' Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: Stderr: '' Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last): Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/opt/stack/nova/nova/compute/manager.py", line 4265, in _do_rebuild_instance Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi self.driver.rebuild(**kwargs) Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/opt/stack/nova/nova/virt/driver.py", line 534, in rebuild Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi raise NotImplementedError() Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi NotImplementedError Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi During handling of the above exception, another exception occurred: Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last): Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py", line 227, in _get_ips_iqns_luns Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ips_iqns_luns = method(connection_properties) Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py", line 386, in _get_discoverydb_portals Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi out = self._run_iscsiadm_bare(['-m', 'discoverydb', Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py", line 1218, in _run_iscsiadm_bare Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi (out, err) = self._execute('iscsiadm', Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/os_brick/executor.py", line 55, in _execute Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi result = self.__execute(*args, **kwargs) Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 173, in execute Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi return execute_root(*cmd, **kwargs) Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 267, in _wrap Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi return self.channel.remote_call(name, args, kwargs, Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 230, in remote_call Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi raise exc_type(*result[2]) Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command. Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1 Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21 Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n' Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Stderr: '' Jan 26 19:10:47.104173 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Jan 26 19:10:47.105027 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Skipping cleanup Unable to find target portal 38.102.83.18:3260. {{(pid=189076) _cleanup_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:959}} Jan 26 19:10:47.105027 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.017s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:10:47.105104 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] <== disconnect_volume: return (17ms) None {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:10:47.105305 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Disconnected iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jan 26 19:10:47.224955 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:47.295478 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:47.354898 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Creating config drive at /opt/stack/data/nova/instances/485e04ea-4ea2-4b13-83c3-71ab6c3531e3/disk.config Jan 26 19:10:47.360847 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/485e04ea-4ea2-4b13-83c3-71ab6c3531e3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpxci0d040 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:47.463676 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Releasing lock "refresh_cache-d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:10:47.464320 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Instance network_info: |[{"id": "4841e3d0-589b-4d89-9700-763060784597", "address": "fa:16:3e:8b:fc:cc", "network": {"id": "94b85e06-699e-4d2b-a361-6a62d99d858f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1614914474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261cb1c98c954302ba86efa2ceee43f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4841e3d0-58", "ovs_interfaceid": "4841e3d0-589b-4d89-9700-763060784597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:10:47.466984 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Start _get_guest_xml network_info=[{"id": "4841e3d0-589b-4d89-9700-763060784597", "address": "fa:16:3e:8b:fc:cc", "network": {"id": "94b85e06-699e-4d2b-a361-6a62d99d858f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1614914474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261cb1c98c954302ba86efa2ceee43f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4841e3d0-58", "ovs_interfaceid": "4841e3d0-589b-4d89-9700-763060784597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:10:47.472784 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:10:47.473920 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-305096841', uuid='d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f'), owner=OwnerMeta(userid='e6cbe3740f6c4303bbf3e5d5c92677db', username='tempest-VolumesBackupsTest-97611117-project-member', projectid='261cb1c98c954302ba86efa2ceee43f2', projectname='tempest-VolumesBackupsTest-97611117'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4841e3d0-589b-4d89-9700-763060784597", "address": "fa:16:3e:8b:fc:cc", "network": {"id": "94b85e06-699e-4d2b-a361-6a62d99d858f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1614914474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261cb1c98c954302ba86efa2ceee43f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4841e3d0-58", "ovs_interfaceid": "4841e3d0-589b-4d89-9700-763060784597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472647.4735806) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:10:47.475391 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:10:47.476446 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:10:47.477689 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:10:47.478013 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:10:47.478977 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:10:47.479456 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:10:47.479456 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:10:47.479693 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:10:47.480222 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:10:47.480222 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:10:47.480222 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:10:47.480222 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:10:47.480332 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:10:47.480490 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:10:47.480617 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:10:47.480755 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:10:47.484106 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:10:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-305096841',display_name='tempest-VolumesBackupsTest-instance-305096841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-volumesbackupstest-instance-305096841',id=85,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEoWGA//ycCzHyCNmfjqGY67sPn/RYnPIcUiogCE5JX2MK8RVLMTgw4M8EN62b43v+gVV9Fix1Vcj0RrzONXcf1ZdBX7fw88tu15QIuXovRupgOwB4Ss7HoKAv7hmxErQ==',key_name='tempest-keypair-1567284510',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='261cb1c98c954302ba86efa2ceee43f2',ramdisk_id='',reservation_id='r-ein08f7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-97611117',owner_user_name='tempest-VolumesBackupsTest-97611117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:10:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6cbe3740f6c4303bbf3e5d5c92677db',uuid=d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4841e3d0-589b-4d89-9700-763060784597", "address": "fa:16:3e:8b:fc:cc", "network": {"id": "94b85e06-699e-4d2b-a361-6a62d99d858f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1614914474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261cb1c98c954302ba86efa2ceee43f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4841e3d0-58", "ovs_interfaceid": "4841e3d0-589b-4d89-9700-763060784597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:10:47.484331 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Converting VIF {"id": "4841e3d0-589b-4d89-9700-763060784597", "address": "fa:16:3e:8b:fc:cc", "network": {"id": "94b85e06-699e-4d2b-a361-6a62d99d858f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1614914474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261cb1c98c954302ba86efa2ceee43f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4841e3d0-58", "ovs_interfaceid": "4841e3d0-589b-4d89-9700-763060784597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:10:47.484849 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:fc:cc,bridge_name='br-int',has_traffic_filtering=True,id=4841e3d0-589b-4d89-9700-763060784597,network=Network(94b85e06-699e-4d2b-a361-6a62d99d858f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4841e3d0-58') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:10:47.485418 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lazy-loading 'pci_devices' on Instance uuid d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:10:47.492194 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/485e04ea-4ea2-4b13-83c3-71ab6c3531e3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpxci0d040" returned: 0 in 0.131s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:47.567921 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:47.574446 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:47.703856 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c60b4fea-02e6-402a-9c39-ed88e030eec6 req-77f14437-59cf-462e-bad5-26cf7fae65b2 service nova] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Received event network-vif-plugged-a358cff6-23db-41f5-abae-f01e3b72b301 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:47.704038 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c60b4fea-02e6-402a-9c39-ed88e030eec6 req-77f14437-59cf-462e-bad5-26cf7fae65b2 service nova] Acquiring lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:47.704215 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c60b4fea-02e6-402a-9c39-ed88e030eec6 req-77f14437-59cf-462e-bad5-26cf7fae65b2 service nova] Lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:47.706035 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c60b4fea-02e6-402a-9c39-ed88e030eec6 req-77f14437-59cf-462e-bad5-26cf7fae65b2 service nova] Lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:47.710569 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c60b4fea-02e6-402a-9c39-ed88e030eec6 req-77f14437-59cf-462e-bad5-26cf7fae65b2 service nova] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Processing event network-vif-plugged-a358cff6-23db-41f5-abae-f01e3b72b301 {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:10:47.726895 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:47.728389 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:47.744450 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:10:47.745263 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:10:47.745417 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] VM Started (Lifecycle Event) Jan 26 19:10:47.751368 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:10:47.755128 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Instance spawned successfully. Jan 26 19:10:47.755352 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] End _get_guest_xml xml= Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: instance-00000055 Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: tempest-VolumesBackupsTest-instance-305096841 Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:10:47 Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: tempest-VolumesBackupsTest-97611117-project-member Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: tempest-VolumesBackupsTest-97611117 Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:10:47.988542 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:10:47.991007 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Preparing to wait for external event network-vif-plugged-4841e3d0-589b-4d89-9700-763060784597 {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:10:47.991007 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:47.991007 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:47.991007 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:47.991007 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:10:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-305096841',display_name='tempest-VolumesBackupsTest-instance-305096841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-volumesbackupstest-instance-305096841',id=85,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEoWGA//ycCzHyCNmfjqGY67sPn/RYnPIcUiogCE5JX2MK8RVLMTgw4M8EN62b43v+gVV9Fix1Vcj0RrzONXcf1ZdBX7fw88tu15QIuXovRupgOwB4Ss7HoKAv7hmxErQ==',key_name='tempest-keypair-1567284510',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='261cb1c98c954302ba86efa2ceee43f2',ramdisk_id='',reservation_id='r-ein08f7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-97611117',owner_user_name='tempest-VolumesBackupsTest-97611117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:10:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6cbe3740f6c4303bbf3e5d5c92677db',uuid=d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4841e3d0-589b-4d89-9700-763060784597", "address": "fa:16:3e:8b:fc:cc", "network": {"id": "94b85e06-699e-4d2b-a361-6a62d99d858f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1614914474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261cb1c98c954302ba86efa2ceee43f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4841e3d0-58", "ovs_interfaceid": "4841e3d0-589b-4d89-9700-763060784597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:10:47.991189 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Converting VIF {"id": "4841e3d0-589b-4d89-9700-763060784597", "address": "fa:16:3e:8b:fc:cc", "network": {"id": "94b85e06-699e-4d2b-a361-6a62d99d858f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1614914474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261cb1c98c954302ba86efa2ceee43f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4841e3d0-58", "ovs_interfaceid": "4841e3d0-589b-4d89-9700-763060784597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:10:47.991189 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:fc:cc,bridge_name='br-int',has_traffic_filtering=True,id=4841e3d0-589b-4d89-9700-763060784597,network=Network(94b85e06-699e-4d2b-a361-6a62d99d858f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4841e3d0-58') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:10:47.991189 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:fc:cc,bridge_name='br-int',has_traffic_filtering=True,id=4841e3d0-589b-4d89-9700-763060784597,network=Network(94b85e06-699e-4d2b-a361-6a62d99d858f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4841e3d0-58') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:10:47.991341 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:47.991578 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:47.991804 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:10:47.992372 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:47.992566 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9e7ef95-cc38-56f9-9d2e-e5b611ec5fdc', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:47.993558 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:47.995188 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:47.997144 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:47.997332 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4841e3d0-58, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:47.997610 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4841e3d0-58, col_values=(('qos', UUID('297ca36a-9cf9-4b09-884a-e33b206ae877')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:47.997788 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4841e3d0-58, col_values=(('external_ids', {'iface-id': '4841e3d0-589b-4d89-9700-763060784597', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:fc:cc', 'vm-uuid': 'd7a8111c-3e4d-4f55-80db-4c3bd80ecb0f'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:47.998574 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:48.001652 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:10:48.005861 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:48.006725 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:fc:cc,bridge_name='br-int',has_traffic_filtering=True,id=4841e3d0-589b-4d89-9700-763060784597,network=Network(94b85e06-699e-4d2b-a361-6a62d99d858f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4841e3d0-58') Jan 26 19:10:48.248605 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:10:48.255899 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:10:48.266360 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:48.266555 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:48.266954 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:48.267441 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:48.267632 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:48.268003 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:48.759236 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:10:48.759457 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:10:48.759658 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] VM Paused (Lifecycle Event) Jan 26 19:10:48.773140 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Took 5.90 seconds to spawn the instance on the hypervisor. Jan 26 19:10:48.773251 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:10:49.226255 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Preparing to wait for external event volume-reimaged-4e3fe1e3-916c-4c11-b288-1ca6609a25da {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:10:49.226647 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Acquiring lock "e644873b-9046-4305-bda6-e6b01555c047-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:49.226647 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:49.226891 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:49.262521 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:10:49.269394 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:10:49.269394 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] VM Resumed (Lifecycle Event) Jan 26 19:10:49.284645 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Took 11.18 seconds to build instance. Jan 26 19:10:49.530015 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:10:49.530144 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:10:49.530311 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] No VIF found with MAC fa:16:3e:8b:fc:cc, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:10:49.531809 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Using config drive Jan 26 19:10:49.771897 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:10:49.783213 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:10:49.786699 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0c0513e8-ca75-4d11-a4e6-eedae1636c4b tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 12.697s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:49.819575 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a3a55468-6195-495e-ad45-72659887296d req-764a8054-fb61-40b2-8565-dee503017cce service nova] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Received event network-vif-plugged-a358cff6-23db-41f5-abae-f01e3b72b301 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:49.819727 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a3a55468-6195-495e-ad45-72659887296d req-764a8054-fb61-40b2-8565-dee503017cce service nova] Acquiring lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:49.819899 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a3a55468-6195-495e-ad45-72659887296d req-764a8054-fb61-40b2-8565-dee503017cce service nova] Lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:49.820028 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a3a55468-6195-495e-ad45-72659887296d req-764a8054-fb61-40b2-8565-dee503017cce service nova] Lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:49.820158 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a3a55468-6195-495e-ad45-72659887296d req-764a8054-fb61-40b2-8565-dee503017cce service nova] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] No waiting events found dispatching network-vif-plugged-a358cff6-23db-41f5-abae-f01e3b72b301 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:10:49.820289 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-a3a55468-6195-495e-ad45-72659887296d req-764a8054-fb61-40b2-8565-dee503017cce service nova] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Received unexpected event network-vif-plugged-a358cff6-23db-41f5-abae-f01e3b72b301 for instance with vm_state active and task_state powering-off. Jan 26 19:10:50.038785 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:50.121943 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-411b0943-6450-4fa4-b683-473e79bde9ba tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3" by "nova.compute.manager.ComputeManager.stop_instance..do_stop_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:50.122137 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-411b0943-6450-4fa4-b683-473e79bde9ba tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3" acquired by "nova.compute.manager.ComputeManager.stop_instance..do_stop_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:50.122285 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-411b0943-6450-4fa4-b683-473e79bde9ba tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:10:50.125671 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-411b0943-6450-4fa4-b683-473e79bde9ba tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=189076) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3483}} Jan 26 19:10:50.126142 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-411b0943-6450-4fa4-b683-473e79bde9ba tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lazy-loading 'flavor' on Instance uuid 485e04ea-4ea2-4b13-83c3-71ab6c3531e3 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:10:50.141035 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Creating config drive at /opt/stack/data/nova/instances/d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f/disk.config Jan 26 19:10:50.145696 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpkgpdwgej {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:50.265700 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpkgpdwgej" returned: 0 in 0.120s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:50.288341 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] During sync_power_state the instance has a pending task (powering-off). Skip. Jan 26 19:10:50.361504 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:50.370819 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:50.610296 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:10:50.610507 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] VM Started (Lifecycle Event) Jan 26 19:10:50.837689 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:50.843216 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:50.848505 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:50.851790 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:51.117535 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:10:51.122127 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:10:51.122451 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] VM Paused (Lifecycle Event) Jan 26 19:10:51.169227 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:51.320980 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:51.326629 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:51.356450 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:51.363623 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:51.403336 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Instance destroyed successfully. Jan 26 19:10:51.403714 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-411b0943-6450-4fa4-b683-473e79bde9ba tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lazy-loading 'numa_topology' on Instance uuid 485e04ea-4ea2-4b13-83c3-71ab6c3531e3 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:10:51.626931 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:10:51.630509 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:10:51.854465 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4ed42a4d-7e7f-47fd-8283-a848684e3763 req-d6a2b7d8-5f3f-487c-a481-037a52afe026 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Received event network-vif-plugged-4841e3d0-589b-4d89-9700-763060784597 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:51.854638 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4ed42a4d-7e7f-47fd-8283-a848684e3763 req-d6a2b7d8-5f3f-487c-a481-037a52afe026 service nova] Acquiring lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:51.856564 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4ed42a4d-7e7f-47fd-8283-a848684e3763 req-d6a2b7d8-5f3f-487c-a481-037a52afe026 service nova] Lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:51.856754 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4ed42a4d-7e7f-47fd-8283-a848684e3763 req-d6a2b7d8-5f3f-487c-a481-037a52afe026 service nova] Lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:51.856932 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4ed42a4d-7e7f-47fd-8283-a848684e3763 req-d6a2b7d8-5f3f-487c-a481-037a52afe026 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Processing event network-vif-plugged-4841e3d0-589b-4d89-9700-763060784597 {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:10:51.857147 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4ed42a4d-7e7f-47fd-8283-a848684e3763 req-d6a2b7d8-5f3f-487c-a481-037a52afe026 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Received event network-vif-plugged-4841e3d0-589b-4d89-9700-763060784597 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:51.857321 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4ed42a4d-7e7f-47fd-8283-a848684e3763 req-d6a2b7d8-5f3f-487c-a481-037a52afe026 service nova] Acquiring lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:51.857621 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4ed42a4d-7e7f-47fd-8283-a848684e3763 req-d6a2b7d8-5f3f-487c-a481-037a52afe026 service nova] Lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:51.857808 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4ed42a4d-7e7f-47fd-8283-a848684e3763 req-d6a2b7d8-5f3f-487c-a481-037a52afe026 service nova] Lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:51.857878 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4ed42a4d-7e7f-47fd-8283-a848684e3763 req-d6a2b7d8-5f3f-487c-a481-037a52afe026 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] No waiting events found dispatching network-vif-plugged-4841e3d0-589b-4d89-9700-763060784597 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:10:51.858020 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-4ed42a4d-7e7f-47fd-8283-a848684e3763 req-d6a2b7d8-5f3f-487c-a481-037a52afe026 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Received unexpected event network-vif-plugged-4841e3d0-589b-4d89-9700-763060784597 for instance with vm_state building and task_state spawning. Jan 26 19:10:51.858201 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4ed42a4d-7e7f-47fd-8283-a848684e3763 req-d6a2b7d8-5f3f-487c-a481-037a52afe026 service nova] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Received event network-vif-unplugged-a358cff6-23db-41f5-abae-f01e3b72b301 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:51.858344 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4ed42a4d-7e7f-47fd-8283-a848684e3763 req-d6a2b7d8-5f3f-487c-a481-037a52afe026 service nova] Acquiring lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:51.858523 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4ed42a4d-7e7f-47fd-8283-a848684e3763 req-d6a2b7d8-5f3f-487c-a481-037a52afe026 service nova] Lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:51.858586 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4ed42a4d-7e7f-47fd-8283-a848684e3763 req-d6a2b7d8-5f3f-487c-a481-037a52afe026 service nova] Lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:51.858783 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4ed42a4d-7e7f-47fd-8283-a848684e3763 req-d6a2b7d8-5f3f-487c-a481-037a52afe026 service nova] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] No waiting events found dispatching network-vif-unplugged-a358cff6-23db-41f5-abae-f01e3b72b301 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:10:51.858939 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-4ed42a4d-7e7f-47fd-8283-a848684e3763 req-d6a2b7d8-5f3f-487c-a481-037a52afe026 service nova] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Received unexpected event network-vif-unplugged-a358cff6-23db-41f5-abae-f01e3b72b301 for instance with vm_state active and task_state powering-off. Jan 26 19:10:51.859074 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4ed42a4d-7e7f-47fd-8283-a848684e3763 req-d6a2b7d8-5f3f-487c-a481-037a52afe026 service nova] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Received event network-vif-unplugged-a358cff6-23db-41f5-abae-f01e3b72b301 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:51.859221 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4ed42a4d-7e7f-47fd-8283-a848684e3763 req-d6a2b7d8-5f3f-487c-a481-037a52afe026 service nova] Acquiring lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:51.859358 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4ed42a4d-7e7f-47fd-8283-a848684e3763 req-d6a2b7d8-5f3f-487c-a481-037a52afe026 service nova] Lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:51.859477 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4ed42a4d-7e7f-47fd-8283-a848684e3763 req-d6a2b7d8-5f3f-487c-a481-037a52afe026 service nova] Lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:51.859650 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4ed42a4d-7e7f-47fd-8283-a848684e3763 req-d6a2b7d8-5f3f-487c-a481-037a52afe026 service nova] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] No waiting events found dispatching network-vif-unplugged-a358cff6-23db-41f5-abae-f01e3b72b301 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:10:51.859729 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-4ed42a4d-7e7f-47fd-8283-a848684e3763 req-d6a2b7d8-5f3f-487c-a481-037a52afe026 service nova] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Received unexpected event network-vif-unplugged-a358cff6-23db-41f5-abae-f01e3b72b301 for instance with vm_state active and task_state powering-off. Jan 26 19:10:51.860439 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:10:51.866969 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:10:51.869635 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Instance spawned successfully. Jan 26 19:10:51.869877 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:10:51.906908 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-411b0943-6450-4fa4-b683-473e79bde9ba tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Object Instance<485e04ea-4ea2-4b13-83c3-71ab6c3531e3> lazy-loaded attributes: flavor,numa_topology {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:10:51.907144 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-411b0943-6450-4fa4-b683-473e79bde9ba tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:10:52.136297 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:10:52.136823 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:10:52.137123 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] VM Resumed (Lifecycle Event) Jan 26 19:10:52.297485 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:52.379079 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:52.379471 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:52.380019 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:52.380584 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:52.381149 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:52.381679 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:10:52.421715 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-411b0943-6450-4fa4-b683-473e79bde9ba tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3" "released" by "nova.compute.manager.ComputeManager.stop_instance..do_stop_instance" :: held 2.296s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:52.643569 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:10:52.646594 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:10:52.889450 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Took 7.05 seconds to spawn the instance on the hypervisor. Jan 26 19:10:52.889634 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:10:53.036406 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:53.153754 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:10:53.230826 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:53.231184 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:53.231334 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:53.231578 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:53.231810 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:53.234872 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Terminating instance Jan 26 19:10:53.275239 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 req-e9298e6a-a443-43d9-b64d-2f6c2e02c8b9 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Received event volume-reimaged-4e3fe1e3-916c-4c11-b288-1ca6609a25da {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:53.275823 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 req-e9298e6a-a443-43d9-b64d-2f6c2e02c8b9 service nova] Acquiring lock "e644873b-9046-4305-bda6-e6b01555c047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:53.276446 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 req-e9298e6a-a443-43d9-b64d-2f6c2e02c8b9 service nova] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:53.276979 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 req-e9298e6a-a443-43d9-b64d-2f6c2e02c8b9 service nova] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:53.277301 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 req-e9298e6a-a443-43d9-b64d-2f6c2e02c8b9 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Processing event volume-reimaged-4e3fe1e3-916c-4c11-b288-1ca6609a25da {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:10:53.278865 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Instance event wait completed in 3 seconds for volume-reimaged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:10:53.399728 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Took 12.35 seconds to build instance. Jan 26 19:10:53.739849 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:10:53.747629 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Instance destroyed successfully. Jan 26 19:10:53.749089 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lazy-loading 'resources' on Instance uuid 485e04ea-4ea2-4b13-83c3-71ab6c3531e3 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:10:53.785296 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.block_device [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Booting with volume 4e3fe1e3-916c-4c11-b288-1ca6609a25da at /dev/vda Jan 26 19:10:53.842929 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': True, 'host': 'np0005596550.novalocal', 'execute': None}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:10:53.844167 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:53.850353 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.006s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:53.850353 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[455eeda8-5eb7-47f3-9b54-8bc82b669dac]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:53.852698 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[c09322e2-c30f-4ae9-990e-6c2b47066ed7]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:10:53.852698 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:10:53.852698 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:10:53.852698 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:10:53.852698 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:53.852698 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:10:53.852698 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:10:53.852698 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:53.852698 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:10:53.852698 np0005596550.novalocal nova-compute[189076]: with open_scini_device() as fd: Jan 26 19:10:53.852698 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:53.852698 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:10:53.852698 np0005596550.novalocal nova-compute[189076]: return next(self.gen) Jan 26 19:10:53.852698 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^ Jan 26 19:10:53.852698 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:10:53.852698 np0005596550.novalocal nova-compute[189076]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:10:53.852698 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:53.852698 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:10:53.854625 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09322e2-c30f-4ae9-990e-6c2b47066ed7]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:53.855112 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.scaleio [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:10:53.855255 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.scaleio [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:10:53.856146 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:53.864839 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:53.865217 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfc42ce-bc43-45ed-83fd-ba9d0f690762]: (4, ('/dev/vda2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:53.866166 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:53.879063 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:53.879199 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f36cbe4-1497-4f2d-b076-629618110d44]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:53.880086 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa96d722-c486-42a1-a367-382655e26dc1]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:53.880434 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Running cmd (subprocess): nvme version {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:53.902613 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] 'nvme version' failed. Not Retrying. {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:10:53.902948 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] nvme not present on system {{(pid=189076) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:10:53.905202 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-252c41d7-3e39-4a20-9695-9f58ef31157f tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 13.875s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:53.905869 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=189076) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:10:53.906901 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.lightos [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fe13:1fe6', 'fe80::4829:71ff:fe7a:59a1', 'fe80::fc16:3eff:fe8b:fccc', 'fe80::80c9:38ff:fe93:555d'] Jan 26 19:10:53.907086 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:10:53.907272 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:10:53.907629 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] <== get_connector_properties: return (64ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': True, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fe13:1fe6', 'fe80::4829:71ff:fe7a:59a1', 'fe80::fc16:3eff:fe8b:fccc', 'fe80::80c9:38ff:fe93:555d']} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:10:53.907913 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.block_device [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Updating existing volume attachment record: 18962ed9-fb26-46a6-bc3f-7e25a7017afe {{(pid=189076) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jan 26 19:10:54.128570 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c7100c62-0a9c-475a-b40f-a368017dc1f5 req-608f3223-ff99-43eb-94e6-06b844784ef5 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Received event network-changed-4841e3d0-589b-4d89-9700-763060784597 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:54.129125 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c7100c62-0a9c-475a-b40f-a368017dc1f5 req-608f3223-ff99-43eb-94e6-06b844784ef5 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Refreshing instance network info cache due to event network-changed-4841e3d0-589b-4d89-9700-763060784597. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:10:54.129429 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c7100c62-0a9c-475a-b40f-a368017dc1f5 req-608f3223-ff99-43eb-94e6-06b844784ef5 service nova] Acquiring lock "refresh_cache-d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:10:54.129662 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c7100c62-0a9c-475a-b40f-a368017dc1f5 req-608f3223-ff99-43eb-94e6-06b844784ef5 service nova] Acquired lock "refresh_cache-d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:10:54.129927 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-c7100c62-0a9c-475a-b40f-a368017dc1f5 req-608f3223-ff99-43eb-94e6-06b844784ef5 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Refreshing network info cache for port 4841e3d0-589b-4d89-9700-763060784597 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:10:54.252865 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:10:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServersTestJSON-server-1199990724',display_name='tempest-Íñstáñcé-1484640292',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstestjson-server-1199990724',id=84,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:10:48Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=4,progress=0,project_id='06fd2a7189d04227bf250a5dcfbc5d96',ramdisk_id='',reservation_id='r-laquilwj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersTestJSON-1441848345',owner_user_name='tempest-ServersTestJSON-1441848345-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:10:52Z,user_data=None,user_id='12364a81a9ea43658a098cdfdb50e3e3',uuid=485e04ea-4ea2-4b13-83c3-71ab6c3531e3,vcpu_model=,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a358cff6-23db-41f5-abae-f01e3b72b301", "address": "fa:16:3e:a9:ad:b4", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa358cff6-23", "ovs_interfaceid": "a358cff6-23db-41f5-abae-f01e3b72b301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:10:54.253325 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converting VIF {"id": "a358cff6-23db-41f5-abae-f01e3b72b301", "address": "fa:16:3e:a9:ad:b4", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa358cff6-23", "ovs_interfaceid": "a358cff6-23db-41f5-abae-f01e3b72b301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:10:54.254132 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ad:b4,bridge_name='br-int',has_traffic_filtering=True,id=a358cff6-23db-41f5-abae-f01e3b72b301,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa358cff6-23') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:10:54.254534 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ad:b4,bridge_name='br-int',has_traffic_filtering=True,id=a358cff6-23db-41f5-abae-f01e3b72b301,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa358cff6-23') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:10:54.255977 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:54.256684 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa358cff6-23, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:54.262917 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:10:54.264178 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:54.264480 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3bafb2e9-bd3d-4d24-88ad-5b55f100d5cc) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:10:54.268666 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:54.270376 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ad:b4,bridge_name='br-int',has_traffic_filtering=True,id=a358cff6-23db-41f5-abae-f01e3b72b301,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa358cff6-23') Jan 26 19:10:54.270919 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Deleting instance files /opt/stack/data/nova/instances/485e04ea-4ea2-4b13-83c3-71ab6c3531e3_del Jan 26 19:10:54.271686 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Deletion of /opt/stack/data/nova/instances/485e04ea-4ea2-4b13-83c3-71ab6c3531e3_del complete Jan 26 19:10:54.637885 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-c7100c62-0a9c-475a-b40f-a368017dc1f5 req-608f3223-ff99-43eb-94e6-06b844784ef5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:54.785848 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Took 1.04 seconds to destroy the instance on the hypervisor. Jan 26 19:10:54.785848 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:10:54.785848 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:10:54.785848 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:10:54.785848 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:54.977107 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:55.125120 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-c7100c62-0a9c-475a-b40f-a368017dc1f5 req-608f3223-ff99-43eb-94e6-06b844784ef5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:10:55.318687 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-593f7272-2416-43c5-beb2-078f1444f463 req-84224441-1310-418f-b271-0ea780ed222f service nova] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Received event network-vif-deleted-a358cff6-23db-41f5-abae-f01e3b72b301 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:10:55.318915 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-593f7272-2416-43c5-beb2-078f1444f463 req-84224441-1310-418f-b271-0ea780ed222f service nova] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Neutron deleted interface a358cff6-23db-41f5-abae-f01e3b72b301; detaching it from the instance and deleting it from the info cache Jan 26 19:10:55.319077 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-593f7272-2416-43c5-beb2-078f1444f463 req-84224441-1310-418f-b271-0ea780ed222f service nova] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:10:55.379316 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-c7100c62-0a9c-475a-b40f-a368017dc1f5 req-608f3223-ff99-43eb-94e6-06b844784ef5 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Updated VIF entry in instance network info cache for port 4841e3d0-589b-4d89-9700-763060784597. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:10:55.379577 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-c7100c62-0a9c-475a-b40f-a368017dc1f5 req-608f3223-ff99-43eb-94e6-06b844784ef5 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Updating instance_info_cache with network_info: [{"id": "4841e3d0-589b-4d89-9700-763060784597", "address": "fa:16:3e:8b:fc:cc", "network": {"id": "94b85e06-699e-4d2b-a361-6a62d99d858f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1614914474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261cb1c98c954302ba86efa2ceee43f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4841e3d0-58", "ovs_interfaceid": "4841e3d0-589b-4d89-9700-763060784597", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:10:55.785508 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:10:55.825291 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-593f7272-2416-43c5-beb2-078f1444f463 req-84224441-1310-418f-b271-0ea780ed222f service nova] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Detach interface failed, port_id=a358cff6-23db-41f5-abae-f01e3b72b301, reason: Instance 485e04ea-4ea2-4b13-83c3-71ab6c3531e3 could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:10:55.882959 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c7100c62-0a9c-475a-b40f-a368017dc1f5 req-608f3223-ff99-43eb-94e6-06b844784ef5 service nova] Releasing lock "refresh_cache-d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:10:56.289752 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Took 1.51 seconds to deallocate network for instance. Jan 26 19:10:56.801237 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:56.801718 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:56.939106 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:10:57.298410 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:57.442804 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:10:57.948688 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.147s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:57.991369 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Deleted allocations for instance 485e04ea-4ea2-4b13-83c3-71ab6c3531e3 Jan 26 19:10:59.001794 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c3844c7-eee4-4f9c-b7b4-5dd7897a4ea7 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "485e04ea-4ea2-4b13-83c3-71ab6c3531e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 5.771s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:59.037572 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:10:59.040142 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Creating image(s) Jan 26 19:10:59.040822 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Did not create local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5295}} Jan 26 19:10:59.041186 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Ensure instance console log exists: /opt/stack/data/nova/instances/e644873b-9046-4305-bda6-e6b01555c047/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:10:59.041635 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:59.043196 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:59.043511 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:59.047142 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Start _get_guest_xml network_info=[{"id": "6f62e7be-24d4-4385-85c3-ad547148947c", "address": "fa:16:3e:34:84:25", "network": {"id": "d63f3398-d114-48c7-9a53-9b0dff093c9d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833956753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "159fa4c355834fd99ccce809dd17e5fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f62e7be-24", "ovs_interfaceid": "6f62e7be-24d4-4385-85c3-ad547148947c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-01-26T23:49:28Z,direct_url=,disk_format='qcow2',id=bd70f82e-84e0-4042-ad07-7b834bb8ac38,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-01-26T23:49:31Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '18962ed9-fb26-46a6-bc3f-7e25a7017afe', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'target_lun': 0, 'volume_id': '4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'auth_method': 'CHAP', 'auth_username': 'vLGbFUG9rYjACzbmVoRC', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e644873b-9046-4305-bda6-e6b01555c047', 'attached_at': '', 'detached_at': '', 'volume_id': '4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'serial': '4e3fe1e3-916c-4c11-b288-1ca6609a25da'}, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:10:59.052233 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError Jan 26 19:10:59.054161 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='bd70f82e-84e0-4042-ad07-7b834bb8ac38', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-1178538683', uuid='e644873b-9046-4305-bda6-e6b01555c047'), owner=OwnerMeta(userid='48586137c66f4adcbebed7d64bf6c678', username='tempest-ServerActionsV293TestJSON-1845614456-project-member', projectid='159fa4c355834fd99ccce809dd17e5fd', projectname='tempest-ServerActionsV293TestJSON-1845614456'), image=ImageMeta(id='', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6f62e7be-24d4-4385-85c3-ad547148947c", "address": "fa:16:3e:34:84:25", "network": {"id": "d63f3398-d114-48c7-9a53-9b0dff093c9d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833956753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "159fa4c355834fd99ccce809dd17e5fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f62e7be-24", "ovs_interfaceid": "6f62e7be-24d4-4385-85c3-ad547148947c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472659.0534394) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:10:59.056363 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:10:59.057151 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:10:59.058547 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:10:59.059256 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:10:59.060740 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:10:59.061509 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-01-26T23:49:28Z,direct_url=,disk_format='qcow2',id=bd70f82e-84e0-4042-ad07-7b834bb8ac38,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-01-26T23:49:31Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:10:59.062019 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:10:59.062311 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:10:59.062625 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:10:59.063081 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:10:59.063463 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:10:59.063866 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:10:59.064150 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:10:59.064509 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:10:59.064757 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:10:59.065320 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:10:59.065670 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lazy-loading 'vcpu_model' on Instance uuid e644873b-9046-4305-bda6-e6b01555c047 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:10:59.266663 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:10:59.504159 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "9d204b32-9530-4994-9cf3-be570ab5f3fc" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:59.504374 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:59.504626 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:10:59.505375 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:10:59.505375 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:10:59.507885 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Terminating instance Jan 26 19:10:59.572859 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Calling os-brick to attach iSCSI Volume {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jan 26 19:10:59.574150 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'target_lun': 0, 'volume_id': '4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'auth_method': 'CHAP', 'auth_username': 'vLGbFUG9rYjACzbmVoRC', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:10:59.574496 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:10:59.575161 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:10:59.575451 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'target_lun': 0, 'volume_id': '4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'auth_method': 'CHAP', 'auth_username': 'vLGbFUG9rYjACzbmVoRC', 'auth_password': 'SbExB4HwxUFZppPd', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True} {{(pid=189076) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:10:59.576552 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:59.582295 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:10:59.583443 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[94af1e06-a381-4185-a20c-7a4ad138b824]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:10:59.583443 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:10:59.583443 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:10:59.583443 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:10:59.583443 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:59.583443 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:10:59.583443 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:10:59.583443 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:59.583443 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:10:59.583443 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:10:59.583443 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:59.583443 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:10:59.583443 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:10:59.583443 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:59.583443 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:10:59.583443 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:10:59.583443 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:10:59.583443 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:10:59.583443 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:10:59.583443 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:10:59.583443 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:10:59.583443 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:10:59.584290 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[94af1e06-a381-4185-a20c-7a4ad138b824]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:59.585259 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:10:59.585897 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:10:59.587270 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:10:59.590226 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:59.598856 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260" returned: 21 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:59.599594 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d501a14-f615-4737-988f-4ff67120f59d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:59.600079 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:10:59.600079 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:10:59.601076 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --interface default --op new {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:10:59.608646 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:10:59.610274 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[f172c59e-09f0-4dc3-ab78-6c1c867a3eb8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:10:59.610826 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da] added Jan 26 19:10:59.610826 np0005596550.novalocal nova-compute[189076]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:10:59.610826 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:10:59.610826 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:10:59.610826 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:10:59.611128 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=189076) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:10:59.611557 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.025(s), this was the 1st time calling it. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:10:59.611944 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:11:00.013884 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:11:00.085957 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:00.087544 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:00.091994 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:00.116854 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:00.130160 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:00.235986 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-be80cc28-4f1a-47be-88f6-3a0f01342181 req-ce29582f-7909-4766-8399-9d56dbb06b35 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Received event network-vif-unplugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:11:00.236234 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-be80cc28-4f1a-47be-88f6-3a0f01342181 req-ce29582f-7909-4766-8399-9d56dbb06b35 service nova] Acquiring lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:00.236461 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-be80cc28-4f1a-47be-88f6-3a0f01342181 req-ce29582f-7909-4766-8399-9d56dbb06b35 service nova] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:00.236673 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-be80cc28-4f1a-47be-88f6-3a0f01342181 req-ce29582f-7909-4766-8399-9d56dbb06b35 service nova] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:00.238035 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-be80cc28-4f1a-47be-88f6-3a0f01342181 req-ce29582f-7909-4766-8399-9d56dbb06b35 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] No waiting events found dispatching network-vif-unplugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:11:00.239069 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-be80cc28-4f1a-47be-88f6-3a0f01342181 req-ce29582f-7909-4766-8399-9d56dbb06b35 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Received event network-vif-unplugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:11:00.251410 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:00.269038 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:00.296881 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Instance destroyed successfully. Jan 26 19:11:00.297523 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lazy-loading 'resources' on Instance uuid 9d204b32-9530-4994-9cf3-be570ab5f3fc {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:11:00.333076 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:00.340016 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:00.530164 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:00.538162 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:00.539658 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:00.544351 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:00.549187 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:00.583191 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:00.592951 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:00.616213 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:11:00.619071 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:00.625844 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:00.626044 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f59e24c-65ba-4215-8bdd-a5d21fb67bf9]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.name = iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.tpgt = -1 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.startup = automatic Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.leading_login = No Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.iscsi_ifacename = default Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.net_ifacename = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.ipaddress = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.prefix_len = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.hwaddress = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.transport_name = tcp Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.initiatorname = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.state = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.vlan_id = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.vlan_priority = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.vlan_state = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.iface_num = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.mtu = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.port = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.bootproto = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.subnet_mask = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.gateway = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id_state = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.dhcp_dns = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.dhcp_learn_iqn = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.dhcp_req_vendor_id_state = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id_state = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.dhcp_slp_da = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.fragmentation = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.gratuitous_arp = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.incoming_forwarding = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.tos_state = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.tos = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.ttl = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.delayed_ack = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.tcp_nagle = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf_state = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.tcp_timer_scale = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.tcp_timestamp = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.redirect = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.def_task_mgmt_timeout = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.header_digest = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.data_digest = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.immediate_data = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.initial_r2t = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.data_seq_inorder = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.data_pdu_inorder = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.erl = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.max_receive_data_len = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.first_burst_len = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.max_outstanding_r2t = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.max_burst_len = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.chap_auth = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.bidi_chap = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.strict_login_compliance = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.discovery_auth = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: iface.discovery_logout = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.discovery_address = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.discovery_port = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.discovery_type = fw Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.initial_cmdsn = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.initial_login_retry_max = 8 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.xmit_thread_priority = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.cmds_max = 128 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.queue_depth = 32 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.nr_sessions = 1 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.auth.authmethod = None Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.auth.username = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.auth.password = *** Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.auth.username_in = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.auth.password_in = Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.timeo.replacement_timeout = 120 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FastAbort = Yes Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.InitialR2T = No Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ImmediateData = Yes Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxConnections = 1 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ERL = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.scan = auto Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.reopen_max = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.session.conn_reopen_log_freq = 1 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.conn[0].address = 38.102.83.18 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.conn[0].port = 3260 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.conn[0].startup = manual Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.window_size = 524288 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.DataDigest = None Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.IFMarker = No Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.OFMarker = No Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: # END RECORD Jan 26 19:11:00.627238 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:00.628546 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:00.638835 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:00.638944 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[b130e275-56c1-4f08-a525-e69ab094ae3f]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:00.639273 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:00.639804 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:00.646010 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.006s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:00.646344 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5fca19-63dd-469a-baaf-67827fb4e855]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:00.646538 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:00.647032 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.session.auth.username -v vLGbFUG9rYjACzbmVoRC {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:00.655234 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.session.auth.username -v vLGbFUG9rYjACzbmVoRC" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:00.655491 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[89285f4b-28b2-417b-b5f4-76269ff4c736]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:00.655714 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vLGbFUG9rYjACzbmVoRC'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:00.656698 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:00.664020 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:00.664165 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf707b4-3d43-435c-8b88-a4f40948b3f7]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:00.664557 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:00.665173 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:00.674725 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:00.674936 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4aa32bd-59cf-406b-8f1a-cff3ea450ae0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:00.675176 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jan 26 19:11:00.675176 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:11:00.675326 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jan 26 19:11:00.675326 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:11:00.675490 np0005596550.novalocal nova-compute[189076]: WARNING os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jan 26 19:11:00.675490 np0005596550.novalocal nova-compute[189076]: : NotImplementedError Jan 26 19:11:00.676155 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --login {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:00.690444 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --login" returned: 0 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:00.690654 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b71f20-4860-4b59-a07f-91f0e898c6d9]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:00.691164 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da, portal: 38.102.83.18,3260] successful. Jan 26 19:11:00.691164 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:00.692180 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:00.700755 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:00.700959 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef34883c-c08b-47e5-b711-c726116a71d8]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:00.701277 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:00.702293 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:00.713085 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:00.717189 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dff3447-3486-4aa1-9344-02dd3982def7]: (4, ('tcp: [14] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:00.717189 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da (non-flash) Jan 26 19:11:00.717189 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:11:00.717189 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsi session list stdout=tcp: [14] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da (non-flash) Jan 26 19:11:00.717189 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:11:00.717568 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.132s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:11:00.717991 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Connected to 38.102.83.18:3260 {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:11:00.719022 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] HCTL ('2', '-', '-', 0) found on session 14 with lun 0 {{(pid=189076) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:11:00.719216 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Scanning host 2 c: -, t: -, l: 0) {{(pid=189076) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:11:00.720103 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host2/scan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:00.742803 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host2/scan" returned: 0 in 0.022s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:00.743181 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d18114-f16c-4210-838e-251a683673c2]: (4, ('- - 0', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:00.744142 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Searching for a device in session 14 and hctl ['2', '*', '*', 0] yield: None {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:11:00.801327 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:08:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-₡-794500751',display_name='tempest-₡-794500751',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest--794500751',id=77,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:08:34Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='06fd2a7189d04227bf250a5dcfbc5d96',ramdisk_id='',reservation_id='r-acxf5dba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersTestJSON-1441848345',owner_user_name='tempest-ServersTestJSON-1441848345-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:08:34Z,user_data=None,user_id='12364a81a9ea43658a098cdfdb50e3e3',uuid=9d204b32-9530-4994-9cf3-be570ab5f3fc,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7a8b8a6-13a1-4ba2-95d3-3966f872148e", "address": "fa:16:3e:13:1f:e6", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a8b8a6-13", "ovs_interfaceid": "b7a8b8a6-13a1-4ba2-95d3-3966f872148e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:11:00.801518 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converting VIF {"id": "b7a8b8a6-13a1-4ba2-95d3-3966f872148e", "address": "fa:16:3e:13:1f:e6", "network": {"id": "9942fbbc-130c-4cc6-8e4d-09d1a7f23d37", "bridge": "br-int", "label": "tempest-ServersTestJSON-789646263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "06fd2a7189d04227bf250a5dcfbc5d96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a8b8a6-13", "ovs_interfaceid": "b7a8b8a6-13a1-4ba2-95d3-3966f872148e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:11:00.801978 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:1f:e6,bridge_name='br-int',has_traffic_filtering=True,id=b7a8b8a6-13a1-4ba2-95d3-3966f872148e,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a8b8a6-13') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:11:00.802259 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:1f:e6,bridge_name='br-int',has_traffic_filtering=True,id=b7a8b8a6-13a1-4ba2-95d3-3966f872148e,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a8b8a6-13') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:11:00.803193 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:00.803433 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7a8b8a6-13, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:11:00.805944 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:00.808127 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:11:00.808505 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:00.808729 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6fa144a-6ccd-4263-8389-67de099c7084) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:11:00.809472 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:00.811923 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:11:00.813310 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:1f:e6,bridge_name='br-int',has_traffic_filtering=True,id=b7a8b8a6-13a1-4ba2-95d3-3966f872148e,network=Network(9942fbbc-130c-4cc6-8e4d-09d1a7f23d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a8b8a6-13') Jan 26 19:11:00.813647 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Deleting instance files /opt/stack/data/nova/instances/9d204b32-9530-4994-9cf3-be570ab5f3fc_del Jan 26 19:11:00.814250 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Deletion of /opt/stack/data/nova/instances/9d204b32-9530-4994-9cf3-be570ab5f3fc_del complete Jan 26 19:11:01.293549 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:11:01.293982 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: e644873b-9046-4305-bda6-e6b01555c047] VM Stopped (Lifecycle Event) Jan 26 19:11:01.324961 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Took 1.31 seconds to destroy the instance on the hypervisor. Jan 26 19:11:01.325154 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:11:01.325348 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:11:01.325465 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:11:01.325718 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:11:01.366444 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:11:01.745600 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Searching for a device in session 14 and hctl ['2', '*', '*', 0] yield: sda {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:11:01.745994 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Connected to sda using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'target_lun': 0, 'volume_id': '4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'auth_method': 'CHAP', 'auth_username': 'vLGbFUG9rYjACzbmVoRC', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True} {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:11:01.746482 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.171s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:11:01.746661 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] <== connect_volume: return (2171ms) {'type': 'block', 'scsi_wwn': '36001405e65b5de1f90e4d8581be0a11a', 'path': '/dev/sda'} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:11:01.746930 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '36001405e65b5de1f90e4d8581be0a11a', 'path': '/dev/sda'} {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jan 26 19:11:01.796816 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-664cc893-628a-4e2d-9310-029bfb8dcabd None None] [instance: e644873b-9046-4305-bda6-e6b01555c047] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:11:02.185148 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:11:02.254055 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-01-27T00:09:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1178538683',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionsv293testjson-server-1897556847',id=82,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMleCBrZBqJ3bjgXVIsALOmKVUFCcb37z9LQkq4/iqQlFLQoYPVskU6EQUtERGdJ+j9iydCEKOj11OCXZNr3wo6GhNqY2IPdqhyyzdKUIx044D+00FnIK90zBOamNJRrA==',key_name='tempest-keypair-352548147',keypairs=,launch_index=0,launched_at=2026-01-27T00:10:14Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='159fa4c355834fd99ccce809dd17e5fd',ramdisk_id='',reservation_id='r-uve25rn8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bd70f82e-84e0-4042-ad07-7b834bb8ac38',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1845614456',owner_user_name='tempest-ServerActionsV293TestJSON-1845614456-project-member'},tags=,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:10:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48586137c66f4adcbebed7d64bf6c678',uuid=e644873b-9046-4305-bda6-e6b01555c047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f62e7be-24d4-4385-85c3-ad547148947c", "address": "fa:16:3e:34:84:25", "network": {"id": "d63f3398-d114-48c7-9a53-9b0dff093c9d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833956753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "159fa4c355834fd99ccce809dd17e5fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f62e7be-24", "ovs_interfaceid": "6f62e7be-24d4-4385-85c3-ad547148947c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:11:02.254648 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Converting VIF {"id": "6f62e7be-24d4-4385-85c3-ad547148947c", "address": "fa:16:3e:34:84:25", "network": {"id": "d63f3398-d114-48c7-9a53-9b0dff093c9d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833956753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "159fa4c355834fd99ccce809dd17e5fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f62e7be-24", "ovs_interfaceid": "6f62e7be-24d4-4385-85c3-ad547148947c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:11:02.256808 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:84:25,bridge_name='br-int',has_traffic_filtering=True,id=6f62e7be-24d4-4385-85c3-ad547148947c,network=Network(d63f3398-d114-48c7-9a53-9b0dff093c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f62e7be-24') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] End _get_guest_xml xml= Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: e644873b-9046-4305-bda6-e6b01555c047 Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: instance-00000052 Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsV293TestJSON-server-1178538683 Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:10:59 Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsV293TestJSON-1845614456-project-member Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: tempest-ServerActionsV293TestJSON-1845614456 Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: e644873b-9046-4305-bda6-e6b01555c047 Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: e644873b-9046-4305-bda6-e6b01555c047 Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: 4e3fe1e3-916c-4c11-b288-1ca6609a25da Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:02.257653 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:11:02.259599 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-01-27T00:09:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1178538683',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionsv293testjson-server-1897556847',id=82,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMleCBrZBqJ3bjgXVIsALOmKVUFCcb37z9LQkq4/iqQlFLQoYPVskU6EQUtERGdJ+j9iydCEKOj11OCXZNr3wo6GhNqY2IPdqhyyzdKUIx044D+00FnIK90zBOamNJRrA==',key_name='tempest-keypair-352548147',keypairs=,launch_index=0,launched_at=2026-01-27T00:10:14Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='159fa4c355834fd99ccce809dd17e5fd',ramdisk_id='',reservation_id='r-uve25rn8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bd70f82e-84e0-4042-ad07-7b834bb8ac38',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1845614456',owner_user_name='tempest-ServerActionsV293TestJSON-1845614456-project-member'},tags=,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:10:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48586137c66f4adcbebed7d64bf6c678',uuid=e644873b-9046-4305-bda6-e6b01555c047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f62e7be-24d4-4385-85c3-ad547148947c", "address": "fa:16:3e:34:84:25", "network": {"id": "d63f3398-d114-48c7-9a53-9b0dff093c9d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833956753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "159fa4c355834fd99ccce809dd17e5fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f62e7be-24", "ovs_interfaceid": "6f62e7be-24d4-4385-85c3-ad547148947c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:11:02.259599 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Converting VIF {"id": "6f62e7be-24d4-4385-85c3-ad547148947c", "address": "fa:16:3e:34:84:25", "network": {"id": "d63f3398-d114-48c7-9a53-9b0dff093c9d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833956753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "159fa4c355834fd99ccce809dd17e5fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f62e7be-24", "ovs_interfaceid": "6f62e7be-24d4-4385-85c3-ad547148947c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:11:02.260562 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:84:25,bridge_name='br-int',has_traffic_filtering=True,id=6f62e7be-24d4-4385-85c3-ad547148947c,network=Network(d63f3398-d114-48c7-9a53-9b0dff093c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f62e7be-24') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:11:02.260966 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:84:25,bridge_name='br-int',has_traffic_filtering=True,id=6f62e7be-24d4-4385-85c3-ad547148947c,network=Network(d63f3398-d114-48c7-9a53-9b0dff093c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f62e7be-24') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:11:02.261849 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:02.262158 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:11:02.262443 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:11:02.263184 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:02.263389 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c97be13f-2357-51af-afdd-bf482e5d6edb', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:11:02.317958 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:02.321185 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:02.326333 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Received event network-vif-unplugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:11:02.326579 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] Acquiring lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:02.326865 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:02.327078 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:02.327267 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] No waiting events found dispatching network-vif-unplugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:11:02.327453 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Received event network-vif-unplugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:11:02.327639 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Received event network-vif-plugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:11:02.327859 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] Acquiring lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:02.328066 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:02.328239 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:02.328444 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] No waiting events found dispatching network-vif-plugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:11:02.328707 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Received unexpected event network-vif-plugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e for instance with vm_state active and task_state deleting. Jan 26 19:11:02.329367 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Received event network-vif-plugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:11:02.329608 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] Acquiring lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:02.329989 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:02.330349 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:02.330349 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] No waiting events found dispatching network-vif-plugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:11:02.330561 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Received unexpected event network-vif-plugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e for instance with vm_state active and task_state deleting. Jan 26 19:11:02.330733 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Received event network-vif-unplugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:11:02.330919 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] Acquiring lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:02.331141 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:02.331294 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:02.331468 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] No waiting events found dispatching network-vif-unplugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:11:02.331650 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Received event network-vif-unplugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:11:02.331849 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Received event network-vif-unplugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:11:02.332031 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] Acquiring lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:02.332222 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:02.332393 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:02.332574 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] No waiting events found dispatching network-vif-unplugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:11:02.332756 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Received event network-vif-unplugged-b7a8b8a6-13a1-4ba2-95d3-3966f872148e for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:11:02.332959 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ce00c0a7-2031-4c28-a0ad-e32798a19a18 req-453e544f-b85a-4a94-b478-6ac9250e7296 service nova] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Received event network-vif-deleted-b7a8b8a6-13a1-4ba2-95d3-3966f872148e {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:11:02.334268 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:02.334616 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f62e7be-24, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:11:02.335174 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f62e7be-24, col_values=(('qos', UUID('9267e4c4-2830-451b-ab6a-a685477e2ad1')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:11:02.335436 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f62e7be-24, col_values=(('external_ids', {'iface-id': '6f62e7be-24d4-4385-85c3-ad547148947c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:84:25', 'vm-uuid': 'e644873b-9046-4305-bda6-e6b01555c047'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:11:02.337970 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:02.340169 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:11:02.345427 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:02.346694 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:84:25,bridge_name='br-int',has_traffic_filtering=True,id=6f62e7be-24d4-4385-85c3-ad547148947c,network=Network(d63f3398-d114-48c7-9a53-9b0dff093c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f62e7be-24') Jan 26 19:11:02.689964 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Took 1.36 seconds to deallocate network for instance. Jan 26 19:11:03.203265 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:03.203560 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:03.360403 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:11:03.869811 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:11:03.880273 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:11:03.880866 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:11:03.884800 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] No VIF found with MAC fa:16:3e:34:84:25, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:11:03.885226 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Using config drive Jan 26 19:11:04.380812 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.175s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:04.405249 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lazy-loading 'ec2_ids' on Instance uuid e644873b-9046-4305-bda6-e6b01555c047 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:11:04.439802 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Deleted allocations for instance 9d204b32-9530-4994-9cf3-be570ab5f3fc Jan 26 19:11:04.919372 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Object Instance lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:11:04.919372 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lazy-loading 'keypairs' on Instance uuid e644873b-9046-4305-bda6-e6b01555c047 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:11:05.426831 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Object Instance lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:11:05.429115 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError Jan 26 19:11:05.451536 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bcfd12e8-9b83-499f-9327-3171178a58a3 tempest-ServersTestJSON-1441848345 tempest-ServersTestJSON-1441848345-project-member] Lock "9d204b32-9530-4994-9cf3-be570ab5f3fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 5.947s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:05.586088 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Creating config drive at /opt/stack/data/nova/instances/e644873b-9046-4305-bda6-e6b01555c047/disk.config Jan 26 19:11:05.592358 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/e644873b-9046-4305-bda6-e6b01555c047/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpd5cimttf {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:05.720226 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/e644873b-9046-4305-bda6-e6b01555c047/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpd5cimttf" returned: 0 in 0.126s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:05.778996 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:05.793166 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:05.964795 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-01bc2cca-4df9-4808-baf1-6ba5498275d9 req-b4267796-87d5-4832-8685-d0f299792c9d service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Received event network-vif-plugged-6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:11:05.964795 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-01bc2cca-4df9-4808-baf1-6ba5498275d9 req-b4267796-87d5-4832-8685-d0f299792c9d service nova] Acquiring lock "e644873b-9046-4305-bda6-e6b01555c047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:05.964795 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-01bc2cca-4df9-4808-baf1-6ba5498275d9 req-b4267796-87d5-4832-8685-d0f299792c9d service nova] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:05.964795 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-01bc2cca-4df9-4808-baf1-6ba5498275d9 req-b4267796-87d5-4832-8685-d0f299792c9d service nova] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:05.964795 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-01bc2cca-4df9-4808-baf1-6ba5498275d9 req-b4267796-87d5-4832-8685-d0f299792c9d service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] No waiting events found dispatching network-vif-plugged-6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:11:05.965077 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-01bc2cca-4df9-4808-baf1-6ba5498275d9 req-b4267796-87d5-4832-8685-d0f299792c9d service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Received unexpected event network-vif-plugged-6f62e7be-24d4-4385-85c3-ad547148947c for instance with vm_state active and task_state rebuild_spawning. Jan 26 19:11:06.006816 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:11:06.007228 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e644873b-9046-4305-bda6-e6b01555c047] VM Resumed (Lifecycle Event) Jan 26 19:11:06.014208 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Instance event wait completed in 0 seconds for {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:11:06.014484 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:11:06.025874 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: e644873b-9046-4305-bda6-e6b01555c047] Instance spawned successfully. Jan 26 19:11:06.025874 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:11:06.076795 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:06.079444 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:06.082435 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:06.084669 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:06.085849 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:06.516439 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e644873b-9046-4305-bda6-e6b01555c047] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:11:06.519809 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e644873b-9046-4305-bda6-e6b01555c047] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:11:06.539367 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:11:06.539795 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:11:06.540312 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:11:06.540859 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:11:06.541364 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:11:06.541883 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:11:07.023251 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e644873b-9046-4305-bda6-e6b01555c047] During sync_power_state the instance has a pending task (rebuild_spawning). Skip. Jan 26 19:11:07.023251 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:11:07.023499 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e644873b-9046-4305-bda6-e6b01555c047] VM Started (Lifecycle Event) Jan 26 19:11:07.050379 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:11:07.137711 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:11:07.138109 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] VM Stopped (Lifecycle Event) Jan 26 19:11:07.318824 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:07.338055 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:07.361344 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:07.527080 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e644873b-9046-4305-bda6-e6b01555c047] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:11:07.532123 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e644873b-9046-4305-bda6-e6b01555c047] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:11:07.563250 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:07.563703 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:07.564024 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Trying to apply a migration context that does not seem to be set for this instance {{(pid=189076) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}} Jan 26 19:11:07.643556 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-9d7f560f-9352-4b12-98bb-ebef92a6455a None None] [instance: 485e04ea-4ea2-4b13-83c3-71ab6c3531e3] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:11:08.019637 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-bc9e584a-89e7-4cb3-8301-14b05b123a19 req-29328977-eb32-48fe-8ffb-ec0428ac6c57 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Received event network-vif-plugged-6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:11:08.019637 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-bc9e584a-89e7-4cb3-8301-14b05b123a19 req-29328977-eb32-48fe-8ffb-ec0428ac6c57 service nova] Acquiring lock "e644873b-9046-4305-bda6-e6b01555c047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:08.019637 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-bc9e584a-89e7-4cb3-8301-14b05b123a19 req-29328977-eb32-48fe-8ffb-ec0428ac6c57 service nova] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:08.022009 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-bc9e584a-89e7-4cb3-8301-14b05b123a19 req-29328977-eb32-48fe-8ffb-ec0428ac6c57 service nova] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:08.022009 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-bc9e584a-89e7-4cb3-8301-14b05b123a19 req-29328977-eb32-48fe-8ffb-ec0428ac6c57 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] No waiting events found dispatching network-vif-plugged-6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:11:08.022219 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-bc9e584a-89e7-4cb3-8301-14b05b123a19 req-29328977-eb32-48fe-8ffb-ec0428ac6c57 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Received unexpected event network-vif-plugged-6f62e7be-24d4-4385-85c3-ad547148947c for instance with vm_state active and task_state None. Jan 26 19:11:08.576957 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0aa61246-5da2-4ac4-9fb9-6a4b99152ec3 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.013s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:10.805669 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Acquiring lock "0da3ba5a-4d62-4ee6-a318-a93ddc4353cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:10.806318 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "0da3ba5a-4d62-4ee6-a318-a93ddc4353cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:11.308811 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:11:11.865927 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:11.866194 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:11.870082 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:11:11.870281 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Claim successful on node np0005596550.novalocal Jan 26 19:11:12.370714 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:11:12.370714 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:11:12.370714 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:11:12.370714 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:11:12.373850 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:12.374841 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:11:13.011010 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:11:13.516893 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:11:14.025490 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.159s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:14.025950 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:11:14.535818 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Not allocating networking since 'none' was specified. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2039}} Jan 26 19:11:15.033979 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:11:15.295838 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:11:15.295838 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] VM Stopped (Lifecycle Event) Jan 26 19:11:15.538243 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:11:15.799343 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-7368fa2f-5261-4d9b-b5c8-d05d53b5f38c None None] [instance: 9d204b32-9530-4994-9cf3-be570ab5f3fc] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:11:16.549049 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:11:16.550749 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:11:16.551329 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Creating image(s) Jan 26 19:11:16.552164 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Acquiring lock "/opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:16.552549 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "/opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:16.553529 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "/opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:16.554968 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:11:16.561429 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:11:16.563362 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:16.637791 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.074s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:16.638235 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:16.638745 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:16.640190 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:11:16.644108 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:11:16.645067 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:16.717062 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.072s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:16.717462 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:16.753745 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk 1073741824" returned: 0 in 0.036s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:16.754196 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.115s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:16.754581 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:16.825522 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.070s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:16.825889 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:11:16.826224 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:16.901928 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:16.902396 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Cannot resize image /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:11:16.902891 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:11:16.903156 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Ensure instance console log exists: /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:11:16.903522 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:16.904208 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:16.904453 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:16.906116 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Start _get_guest_xml network_info=[] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:11:16.909655 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:11:16.911289 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerShowV257Test-server-1179187697', uuid='0da3ba5a-4d62-4ee6-a318-a93ddc4353cd'), owner=OwnerMeta(userid='c04d331bf4484155a389e097fc17e8fa', username='tempest-ServerShowV257Test-1759714723-project-member', projectid='c93a031f1a7e435bbf31e3e79cd793ac', projectname='tempest-ServerShowV257Test-1759714723'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[], nova_package='32.1.0', creation_time=1769472676.910859) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:11:16.915335 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:11:16.915787 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:11:16.917243 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:11:16.917786 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:11:16.918970 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:11:16.919414 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:11:16.919651 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:11:16.919852 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:11:16.920065 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:11:16.920236 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:11:16.920406 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:11:16.920662 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:11:16.920961 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:11:16.921174 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:11:16.921364 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:11:16.921569 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:11:16.925700 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lazy-loading 'pci_devices' on Instance uuid 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:11:17.414552 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:11:17.414552 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:11:17.414552 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:11:17.414552 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:11:17.416815 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:17.417943 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] End _get_guest_xml xml= Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: instance-00000056 Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: tempest-ServerShowV257Test-server-1179187697 Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:11:16 Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: tempest-ServerShowV257Test-1759714723-project-member Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: tempest-ServerShowV257Test-1759714723 Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:17.431890 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:11:17.895794 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:11:17.896272 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:11:18.404248 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:18.404690 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:18.405170 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:18.405531 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:11:18.950795 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:11:18.951228 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:11:18.951512 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Using config drive Jan 26 19:11:19.439314 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:19.459742 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:11:19.500582 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Creating config drive at /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk.config Jan 26 19:11:19.506411 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpjilk8xki {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:19.549789 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:19.549789 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:19.620103 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f/disk --force-share --output=json" returned: 0 in 0.072s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:19.623745 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:19.633129 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpjilk8xki" returned: 0 in 0.126s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:19.706804 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:19.706804 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:19.779800 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk --force-share --output=json" returned: 0 in 0.074s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:19.785169 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] skipping disk /dev/sda (vda) as it is a volume {{(pid=189076) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12209}} Jan 26 19:11:19.845138 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:11:19.845552 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] VM Resumed (Lifecycle Event) Jan 26 19:11:19.847713 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Instance event wait completed in 0 seconds for {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:11:19.847981 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:11:19.855730 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Instance spawned successfully. Jan 26 19:11:19.857651 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:11:19.908114 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:11:19.909314 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:19.926321 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.017s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:19.926750 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=7540MB free_disk=373.0910453796387GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:11:19.927035 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:19.927348 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:20.350057 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:11:20.352808 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:11:20.367009 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:11:20.367271 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:11:20.368153 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:11:20.368286 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:11:20.368608 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:11:20.369088 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:11:20.858131 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:11:20.858341 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:11:20.858526 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] VM Started (Lifecycle Event) Jan 26 19:11:20.874191 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Took 4.32 seconds to spawn the instance on the hypervisor. Jan 26 19:11:20.874520 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:11:20.982229 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance e644873b-9046-4305-bda6-e6b01555c047 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:11:20.982417 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:11:20.982561 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:11:20.982797 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 3 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:11:20.982985 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=1088MB phys_disk=399GB used_disk=2GB total_vcpus=8 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:11:19 up 39 min, 13 users, load average: 5.38, 5.40, 4.25\n', 'num_instances': '3', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '3', 'num_proj_159fa4c355834fd99ccce809dd17e5fd': '1', 'io_workload': '1', 'num_proj_261cb1c98c954302ba86efa2ceee43f2': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_c93a031f1a7e435bbf31e3e79cd793ac': '1'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:11:21.200470 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:11:21.361350 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:11:21.366836 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:11:21.385352 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Took 9.57 seconds to build instance. Jan 26 19:11:21.703865 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:11:21.888562 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a7add2f-1d94-45fc-85d9-90600068d2f4 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "0da3ba5a-4d62-4ee6-a318-a93ddc4353cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 11.082s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:22.209192 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:11:22.209485 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.282s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:22.418867 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:11:22.420552 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:11:22.420552 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:11:22.420552 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:11:22.458820 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:22.458820 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:11:23.210493 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:11:23.210493 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:11:23.210822 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:11:23.433896 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Rebuilding instance Jan 26 19:11:23.538169 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:11:24.792514 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Instance destroyed successfully. Jan 26 19:11:24.798860 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Instance destroyed successfully. Jan 26 19:11:24.798860 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Deleting instance files /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd_del Jan 26 19:11:24.799280 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Deletion of /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd_del complete Jan 26 19:11:25.893487 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:11:25.895084 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:11:26.321789 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:11:26.321789 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Creating image(s) Jan 26 19:11:26.321789 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Acquiring lock "/opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:26.321789 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "/opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:26.322626 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "/opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:26.323269 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:11:26.327646 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:11:26.329014 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:26.439932 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json" returned: 0 in 0.109s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:26.440447 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Acquiring lock "791283f4306f6266c365d052f132d740f0c9b85f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:26.441548 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "791283f4306f6266c365d052f132d740f0c9b85f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:26.446481 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:11:26.452135 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:11:26.453254 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:26.521707 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json" returned: 0 in 0.068s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:26.522601 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f,backing_fmt=raw /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:26.558801 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f,backing_fmt=raw /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk 1073741824" returned: 0 in 0.036s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:26.559332 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "791283f4306f6266c365d052f132d740f0c9b85f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.118s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:26.559667 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:26.626033 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json" returned: 0 in 0.066s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:26.626569 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:11:26.626975 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:26.701637 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk --force-share --output=json" returned: 0 in 0.074s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:26.702200 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Cannot resize image /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:11:26.702622 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:11:26.702926 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Ensure instance console log exists: /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:11:26.703291 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:26.703592 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:26.703832 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:26.705009 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Start _get_guest_xml network_info=[] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-01-26T23:49:28Z,direct_url=,disk_format='qcow2',id=bd70f82e-84e0-4042-ad07-7b834bb8ac38,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-01-26T23:49:31Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:11:26.708746 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError Jan 26 19:11:26.710221 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bd70f82e-84e0-4042-ad07-7b834bb8ac38', instance_meta=NovaInstanceMeta(name='tempest-ServerShowV257Test-server-1179187697', uuid='0da3ba5a-4d62-4ee6-a318-a93ddc4353cd'), owner=OwnerMeta(userid='c04d331bf4484155a389e097fc17e8fa', username='tempest-ServerShowV257Test-1759714723-project-member', projectid='c93a031f1a7e435bbf31e3e79cd793ac', projectname='tempest-ServerShowV257Test-1759714723'), image=ImageMeta(id='bd70f82e-84e0-4042-ad07-7b834bb8ac38', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[], nova_package='32.1.0', creation_time=1769472686.7096684) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:11:26.711432 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:11:26.711891 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:11:26.712958 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:11:26.713239 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:11:26.714184 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:11:26.714604 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-01-26T23:49:28Z,direct_url=,disk_format='qcow2',id=bd70f82e-84e0-4042-ad07-7b834bb8ac38,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-01-26T23:49:31Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:11:26.714918 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:11:26.715098 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:11:26.715296 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:11:26.715470 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:11:26.715647 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:11:26.715903 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:11:26.716091 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:11:26.716286 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:11:26.716480 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:11:26.716672 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:11:26.716923 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:11:26.893046 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:11:26.895505 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:11:26.896455 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] End _get_guest_xml xml= Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: instance-00000056 Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: tempest-ServerShowV257Test-server-1179187697 Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:11:26 Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: tempest-ServerShowV257Test-1759714723-project-member Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: tempest-ServerShowV257Test-1759714723 Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:27.224788 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:11:27.460097 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:11:27.461224 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:11:27.461487 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:11:27.461791 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:11:27.498973 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:27.499705 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:11:28.759837 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:11:28.759837 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:11:28.760476 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Using config drive Jan 26 19:11:29.264854 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lazy-loading 'ec2_ids' on Instance uuid 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:11:29.769630 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Object Instance<0da3ba5a-4d62-4ee6-a318-a93ddc4353cd> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:11:29.770100 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lazy-loading 'keypairs' on Instance uuid 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:11:30.087109 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:30.087318 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:30.274439 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Object Instance<0da3ba5a-4d62-4ee6-a318-a93ddc4353cd> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:11:30.277039 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError Jan 26 19:11:30.310420 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Creating config drive at /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk.config Jan 26 19:11:30.313935 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpwne6e_5o {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:30.436550 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpwne6e_5o" returned: 0 in 0.122s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:30.592392 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lazy-loading 'flavor' on Instance uuid d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:11:30.635840 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:11:30.636063 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:11:30.636359 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] VM Resumed (Lifecycle Event) Jan 26 19:11:30.637542 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Instance event wait completed in 0 seconds for {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:11:30.639998 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:11:30.643874 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Instance spawned successfully. Jan 26 19:11:30.644123 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:11:31.097035 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Ignoring supplied device name: /dev/vdb Jan 26 19:11:31.142708 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:11:31.144796 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:11:31.152239 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:11:31.152443 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:11:31.152787 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:11:31.153028 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:11:31.153299 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:11:31.153666 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:11:31.600702 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.513s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:31.647604 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] During sync_power_state the instance has a pending task (rebuild_spawning). Skip. Jan 26 19:11:31.647880 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:11:31.648058 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] VM Started (Lifecycle Event) Jan 26 19:11:31.659016 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:11:32.151127 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:11:32.155995 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:11:32.171325 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:32.171690 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:32.171969 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Trying to apply a migration context that does not seem to be set for this instance {{(pid=189076) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}} Jan 26 19:11:32.500900 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:11:32.502091 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:11:32.502245 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:11:32.502380 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:11:32.524395 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:32.525332 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:11:32.694804 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:32.694804 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:32.695159 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Attaching volume 7b99cea9-3a13-452e-9141-efcbb218f28b to /dev/vdb Jan 26 19:11:32.729507 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': True, 'host': 'np0005596550.novalocal', 'execute': None}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:11:32.729987 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:32.736471 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.006s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:32.736791 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91e92a9-c7da-47df-a262-cb0407127990]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:32.739883 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[2800fea0-c4a8-4b98-b8b1-30fa3ceda21c]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:11:32.739883 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:11:32.739883 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:11:32.739883 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:11:32.739883 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:11:32.739883 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:11:32.739883 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:11:32.739883 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:11:32.739883 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:11:32.739883 np0005596550.novalocal nova-compute[189076]: with open_scini_device() as fd: Jan 26 19:11:32.739883 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:11:32.739883 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:11:32.739883 np0005596550.novalocal nova-compute[189076]: return next(self.gen) Jan 26 19:11:32.739883 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^ Jan 26 19:11:32.739883 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:11:32.739883 np0005596550.novalocal nova-compute[189076]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:11:32.739883 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:11:32.739883 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:11:32.741182 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[2800fea0-c4a8-4b98-b8b1-30fa3ceda21c]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:32.741182 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.scaleio [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:11:32.741182 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.scaleio [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:11:32.741558 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:32.748896 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:32.749386 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcce6c2-afc3-4ef5-825f-449944b6e009]: (4, ('/dev/vda2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:32.750634 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:32.763443 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:32.764368 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[954fa053-4ba1-4dd5-99b5-bc6972c5d906]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:32.765221 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d6ba4b-bc08-4041-b73b-66d41cf67442]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:32.765889 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Running cmd (subprocess): nvme version {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:32.781822 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] 'nvme version' failed. Not Retrying. {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:11:32.782304 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] nvme not present on system {{(pid=189076) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:11:32.785802 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=189076) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:11:32.785802 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.lightos [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fe8b:fccc', 'fe80::80c9:38ff:fe93:555d', 'fe80::fc16:3eff:fe34:8425', 'fe80::b4c2:8aff:fe71:de47'] Jan 26 19:11:32.785802 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:11:32.786087 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:11:32.786529 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] <== get_connector_properties: return (56ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': True, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fe8b:fccc', 'fe80::80c9:38ff:fe93:555d', 'fe80::fc16:3eff:fe34:8425', 'fe80::b4c2:8aff:fe71:de47']} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:11:32.787007 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.block_device [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Updating existing volume attachment record: 16bf5a90-9f6b-4c69-9725-c304d2178e8d {{(pid=189076) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jan 26 19:11:33.081823 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Acquiring lock "0da3ba5a-4d62-4ee6-a318-a93ddc4353cd" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:33.082234 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "0da3ba5a-4d62-4ee6-a318-a93ddc4353cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:33.082553 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Acquiring lock "0da3ba5a-4d62-4ee6-a318-a93ddc4353cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:33.082872 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "0da3ba5a-4d62-4ee6-a318-a93ddc4353cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:33.083179 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "0da3ba5a-4d62-4ee6-a318-a93ddc4353cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:33.086807 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Terminating instance Jan 26 19:11:33.185303 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-162f7629-d152-4c74-95b2-8d47f6692912 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.013s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:33.591426 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Acquiring lock "refresh_cache-0da3ba5a-4d62-4ee6-a318-a93ddc4353cd" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:11:33.591426 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Acquired lock "refresh_cache-0da3ba5a-4d62-4ee6-a318-a93ddc4353cd" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:11:33.591426 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:11:34.095841 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:11:34.124046 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:11:34.227316 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:11:34.731463 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Releasing lock "refresh_cache-0da3ba5a-4d62-4ee6-a318-a93ddc4353cd" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:11:34.731463 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:11:34.976490 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Instance destroyed successfully. Jan 26 19:11:34.976490 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lazy-loading 'resources' on Instance uuid 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:11:35.478869 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Deleting instance files /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd_del Jan 26 19:11:35.479211 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Deletion of /opt/stack/data/nova/instances/0da3ba5a-4d62-4ee6-a318-a93ddc4353cd_del complete Jan 26 19:11:35.990638 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Took 1.26 seconds to destroy the instance on the hypervisor. Jan 26 19:11:35.991335 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:11:35.991719 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:11:35.991978 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:11:35.992391 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:11:36.045355 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:11:36.045810 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:11:36.343758 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Calling os-brick to attach iSCSI Volume {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jan 26 19:11:36.344604 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b', 'target_lun': 0, 'volume_id': '7b99cea9-3a13-452e-9141-efcbb218f28b', 'auth_method': 'CHAP', 'auth_username': 'xAMSGov4NR4iBpfuFrd8', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:11:36.344908 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:11:36.345352 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:11:36.345588 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b', 'target_lun': 0, 'volume_id': '7b99cea9-3a13-452e-9141-efcbb218f28b', 'auth_method': 'CHAP', 'auth_username': 'xAMSGov4NR4iBpfuFrd8', 'auth_password': 'vVVAhujfDMw8unuk', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True} {{(pid=189076) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:11:36.346566 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:36.354019 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:11:36.356385 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[7bedfbd3-6be8-4812-b2bb-6ef49f17af5f]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:11:36.356385 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:11:36.356385 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:11:36.356385 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:11:36.356385 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:11:36.356385 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:11:36.356385 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:11:36.356385 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:11:36.356385 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:11:36.356385 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:11:36.356385 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:11:36.356385 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:11:36.356385 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:11:36.356385 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:11:36.356385 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:11:36.356385 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:11:36.356385 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:11:36.356385 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:11:36.356385 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:11:36.356385 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:11:36.356385 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:11:36.356385 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:11:36.358404 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bedfbd3-6be8-4812-b2bb-6ef49f17af5f]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:36.359059 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:11:36.359498 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:11:36.359844 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:11:36.360499 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:36.369674 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260" returned: 21 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:36.369830 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f3a701-5a8b-4553-a397-76a435859d4f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:36.370206 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:11:36.370206 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:36.371158 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260 --interface default --op new {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:36.381695 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:36.382263 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39e874c-6f6a-4f53-91d0-998af4a38fc3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:36.382612 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b] added Jan 26 19:11:36.382612 np0005596550.novalocal nova-compute[189076]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:11:36.382612 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:11:36.382612 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:11:36.382612 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:36.382896 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=189076) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:11:36.383212 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.023(s), this was the 1st time calling it. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:11:36.383441 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:11:36.549424 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:11:37.053401 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Took 1.06 seconds to deallocate network for instance. Jan 26 19:11:37.384405 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:11:37.386783 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:37.396303 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:37.396601 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[07415ff4-4017-4045-9013-78ad59ef5520]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.name = iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.tpgt = -1 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.startup = automatic Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.leading_login = No Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.iscsi_ifacename = default Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.net_ifacename = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.ipaddress = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.prefix_len = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.hwaddress = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.transport_name = tcp Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.initiatorname = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.state = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.vlan_id = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.vlan_priority = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.vlan_state = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.iface_num = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.mtu = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.port = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.bootproto = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.subnet_mask = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.gateway = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id_state = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.dhcp_dns = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.dhcp_learn_iqn = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.dhcp_req_vendor_id_state = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id_state = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.dhcp_slp_da = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.fragmentation = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.gratuitous_arp = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.incoming_forwarding = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.tos_state = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.tos = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.ttl = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.delayed_ack = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.tcp_nagle = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf_state = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.tcp_timer_scale = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.tcp_timestamp = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.redirect = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.def_task_mgmt_timeout = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.header_digest = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.data_digest = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.immediate_data = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.initial_r2t = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.data_seq_inorder = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.data_pdu_inorder = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.erl = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.max_receive_data_len = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.first_burst_len = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.max_outstanding_r2t = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.max_burst_len = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.chap_auth = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.bidi_chap = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.strict_login_compliance = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.discovery_auth = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: iface.discovery_logout = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.discovery_address = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.discovery_port = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.discovery_type = fw Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.initial_cmdsn = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.initial_login_retry_max = 8 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.xmit_thread_priority = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.cmds_max = 128 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.queue_depth = 32 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.nr_sessions = 1 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.auth.authmethod = None Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.auth.username = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.auth.password = *** Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.auth.username_in = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.auth.password_in = Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.timeo.replacement_timeout = 120 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FastAbort = Yes Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.InitialR2T = No Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ImmediateData = Yes Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxConnections = 1 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ERL = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.scan = auto Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.reopen_max = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.session.conn_reopen_log_freq = 1 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.conn[0].address = 38.102.83.18 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.conn[0].port = 3260 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.conn[0].startup = manual Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.window_size = 524288 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.DataDigest = None Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.IFMarker = No Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.OFMarker = No Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: # END RECORD Jan 26 19:11:37.398738 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:37.400068 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:37.408988 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:37.409331 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca36f9fc-a02d-4190-905e-57da185a731a]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:37.410240 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:37.411885 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:37.419494 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:37.419735 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f785b6c-d16c-48ae-8071-c2db4602e1c1]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:37.420390 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:37.421871 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260 --op update -n node.session.auth.username -v xAMSGov4NR4iBpfuFrd8 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:37.430075 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260 --op update -n node.session.auth.username -v xAMSGov4NR4iBpfuFrd8" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:37.430402 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf692101-cc28-4688-8b2e-492d46dd52d8]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:37.430919 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xAMSGov4NR4iBpfuFrd8'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:37.431858 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:37.442799 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:37.443071 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e897bf-90db-4fa5-8122-4f96a3d76183]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:37.443760 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:37.444922 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:37.458199 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:37.458450 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e3bf9f-9bea-4263-9649-465a9a0f2dd2]: (4, ('tcp: [14] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:37.458979 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da (non-flash) Jan 26 19:11:37.458979 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:11:37.459347 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsi session list stdout=tcp: [14] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da (non-flash) Jan 26 19:11:37.459347 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:11:37.460478 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260 --login {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:37.480542 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260 --login" returned: 0 in 0.020s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:37.480672 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d7aa9e-7272-4187-8a54-7b36e20225a3]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:37.481052 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b, portal: 38.102.83.18,3260] successful. Jan 26 19:11:37.481052 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:37.483435 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:37.496028 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:37.496248 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[0184429c-95c5-4ee1-991c-f92c1df0af72]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:37.496677 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:37.497580 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:37.510085 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:37.510340 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e84899-bcc9-4d8d-804b-1337088d4b95]: (4, ('tcp: [14] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da (non-flash)\ntcp: [15] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:37.510644 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da (non-flash) Jan 26 19:11:37.510644 np0005596550.novalocal nova-compute[189076]: tcp: [15] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b (non-flash) Jan 26 19:11:37.510644 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:11:37.510906 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsi session list stdout=tcp: [14] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da (non-flash) Jan 26 19:11:37.510906 np0005596550.novalocal nova-compute[189076]: tcp: [15] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b (non-flash) Jan 26 19:11:37.510906 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:11:37.511327 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:11:37.511559 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Connected to 38.102.83.18:3260 {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:11:37.512227 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] HCTL ('3', '-', '-', 0) found on session 15 with lun 0 {{(pid=189076) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:11:37.512457 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Scanning host 3 c: -, t: -, l: 0) {{(pid=189076) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:11:37.513273 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host3/scan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:37.565755 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:11:37.565755 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:11:37.565755 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:11:37.565755 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:11:37.568226 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:37.568226 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:37.568629 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host3/scan" returned: 0 in 0.054s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:37.568969 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae304efb-fcb7-4440-8947-fd599b926592]: (4, ('- - 0', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:37.569312 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:37.570456 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:11:37.571291 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Searching for a device in session 15 and hctl ['3', '*', '*', 0] yield: None {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:11:37.720714 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:11:38.224169 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:11:38.573362 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Searching for a device in session 15 and hctl ['3', '*', '*', 0] yield: sdb {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:11:38.574204 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Connected to sdb using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b', 'target_lun': 0, 'volume_id': '7b99cea9-3a13-452e-9141-efcbb218f28b', 'auth_method': 'CHAP', 'auth_username': 'xAMSGov4NR4iBpfuFrd8', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True} {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:11:38.575096 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.230s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:11:38.575456 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] <== connect_volume: return (2230ms) {'type': 'block', 'scsi_wwn': '36001405f0523eae2cac4f5ba8b159ad9', 'path': '/dev/sdb'} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:11:38.575773 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '36001405f0523eae2cac4f5ba8b159ad9', 'path': '/dev/sdb'} {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jan 26 19:11:38.579795 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lazy-loading 'flavor' on Instance uuid d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:11:38.729260 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.161s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:38.775794 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Deleted allocations for instance 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd Jan 26 19:11:39.088210 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] attach device xml: Jan 26 19:11:39.088210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:39.088210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:39.088210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:39.088210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:39.088210 np0005596550.novalocal nova-compute[189076]: 7b99cea9-3a13-452e-9141-efcbb218f28b Jan 26 19:11:39.088210 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:39.088210 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:330}} Jan 26 19:11:39.787598 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bdfd6ba0-f3b3-492f-9bf4-8417a252ee18 tempest-ServerShowV257Test-1759714723 tempest-ServerShowV257Test-1759714723-project-member] Lock "0da3ba5a-4d62-4ee6-a318-a93ddc4353cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.705s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:40.687865 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:11:40.687865 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] No BDM found with device name vdb, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:11:40.687865 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:11:40.687865 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] No VIF found with MAC fa:16:3e:8b:fc:cc, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:11:40.989229 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:42.239396 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c67a7f8c-9a44-424d-9621-54a7989a2f2b tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 9.545s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:42.567012 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:44.259147 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:45.547642 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Acquiring lock "e644873b-9046-4305-bda6-e6b01555c047" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:45.548047 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "e644873b-9046-4305-bda6-e6b01555c047" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:45.549070 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Acquiring lock "e644873b-9046-4305-bda6-e6b01555c047-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:45.549070 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:45.549239 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:45.552634 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Terminating instance Jan 26 19:11:46.059409 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:11:46.077305 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:46.086279 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:46.095378 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:46.108325 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:46.356135 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: e644873b-9046-4305-bda6-e6b01555c047] Instance destroyed successfully. Jan 26 19:11:46.356562 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lazy-loading 'resources' on Instance uuid e644873b-9046-4305-bda6-e6b01555c047 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:11:46.386471 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-909b8e63-f79a-404c-8bc0-b1a3d153abe1 req-bb0101a6-d776-418e-a327-b48ade95b676 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Received event network-vif-unplugged-6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:11:46.388663 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-909b8e63-f79a-404c-8bc0-b1a3d153abe1 req-bb0101a6-d776-418e-a327-b48ade95b676 service nova] Acquiring lock "e644873b-9046-4305-bda6-e6b01555c047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:46.388894 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-909b8e63-f79a-404c-8bc0-b1a3d153abe1 req-bb0101a6-d776-418e-a327-b48ade95b676 service nova] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:46.389043 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-909b8e63-f79a-404c-8bc0-b1a3d153abe1 req-bb0101a6-d776-418e-a327-b48ade95b676 service nova] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:46.389189 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-909b8e63-f79a-404c-8bc0-b1a3d153abe1 req-bb0101a6-d776-418e-a327-b48ade95b676 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] No waiting events found dispatching network-vif-unplugged-6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:11:46.389337 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-909b8e63-f79a-404c-8bc0-b1a3d153abe1 req-bb0101a6-d776-418e-a327-b48ade95b676 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Received event network-vif-unplugged-6f62e7be-24d4-4385-85c3-ad547148947c for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:11:46.862244 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-01-27T00:09:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1178538683',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveractionsv293testjson-server-1897556847',id=82,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMleCBrZBqJ3bjgXVIsALOmKVUFCcb37z9LQkq4/iqQlFLQoYPVskU6EQUtERGdJ+j9iydCEKOj11OCXZNr3wo6GhNqY2IPdqhyyzdKUIx044D+00FnIK90zBOamNJRrA==',key_name='tempest-keypair-352548147',keypairs=,launch_index=0,launched_at=2026-01-27T00:11:07Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='159fa4c355834fd99ccce809dd17e5fd',ramdisk_id='',reservation_id='r-uve25rn8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bd70f82e-84e0-4042-ad07-7b834bb8ac38',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1845614456',owner_user_name='tempest-ServerActionsV293TestJSON-1845614456-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:11:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48586137c66f4adcbebed7d64bf6c678',uuid=e644873b-9046-4305-bda6-e6b01555c047,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f62e7be-24d4-4385-85c3-ad547148947c", "address": "fa:16:3e:34:84:25", "network": {"id": "d63f3398-d114-48c7-9a53-9b0dff093c9d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833956753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "159fa4c355834fd99ccce809dd17e5fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f62e7be-24", "ovs_interfaceid": "6f62e7be-24d4-4385-85c3-ad547148947c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:11:46.862731 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Converting VIF {"id": "6f62e7be-24d4-4385-85c3-ad547148947c", "address": "fa:16:3e:34:84:25", "network": {"id": "d63f3398-d114-48c7-9a53-9b0dff093c9d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833956753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "159fa4c355834fd99ccce809dd17e5fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f62e7be-24", "ovs_interfaceid": "6f62e7be-24d4-4385-85c3-ad547148947c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:11:46.863232 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:84:25,bridge_name='br-int',has_traffic_filtering=True,id=6f62e7be-24d4-4385-85c3-ad547148947c,network=Network(d63f3398-d114-48c7-9a53-9b0dff093c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f62e7be-24') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:11:46.863500 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:84:25,bridge_name='br-int',has_traffic_filtering=True,id=6f62e7be-24d4-4385-85c3-ad547148947c,network=Network(d63f3398-d114-48c7-9a53-9b0dff093c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f62e7be-24') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:11:46.865143 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:46.865440 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f62e7be-24, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:11:46.867895 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:46.869242 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:46.869952 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:46.870157 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9267e4c4-2830-451b-ab6a-a685477e2ad1) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:11:46.874266 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:11:46.875730 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:84:25,bridge_name='br-int',has_traffic_filtering=True,id=6f62e7be-24d4-4385-85c3-ad547148947c,network=Network(d63f3398-d114-48c7-9a53-9b0dff093c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f62e7be-24') Jan 26 19:11:46.879293 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] calling os-brick to detach iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jan 26 19:11:46.880018 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'target_lun': 0, 'volume_id': '4e3fe1e3-916c-4c11-b288-1ca6609a25da', 'auth_method': 'CHAP', 'auth_username': 'vLGbFUG9rYjACzbmVoRC', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sda'}, None), 'kwargs': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:11:46.880231 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:11:46.880667 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:11:46.883203 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:46.892857 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:46.893478 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e9f20c-b307-4c03-9d44-ca84e3c37f60]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:46.893911 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:11:46.893911 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:11:46.893911 np0005596550.novalocal nova-compute[189076]: iSNS: Jan 26 19:11:46.893911 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:11:46.893911 np0005596550.novalocal nova-compute[189076]: STATIC: Jan 26 19:11:46.893911 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da Jan 26 19:11:46.893911 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:11:46.893911 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:11:46.893911 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b Jan 26 19:11:46.893911 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:11:46.893911 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:11:46.893911 np0005596550.novalocal nova-compute[189076]: FIRMWARE: Jan 26 19:11:46.893911 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:11:46.893911 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:11:46.894180 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:11:46.894180 np0005596550.novalocal nova-compute[189076]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:11:46.894180 np0005596550.novalocal nova-compute[189076]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=189076) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:11:46.894180 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da', 0)] {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:11:46.894920 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:46.902497 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:46.902855 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed9c308-fada-436f-bc12-e2bd1ba8e1d6]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da\n38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:46.904038 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:46.913424 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:46.913574 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[357fdc44-ff2c-43cf-b78a-b9eb0d48eccd]: (4, ('tcp: [14] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da (non-flash)\ntcp: [15] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:46.913910 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da (non-flash) Jan 26 19:11:46.913910 np0005596550.novalocal nova-compute[189076]: tcp: [15] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b (non-flash) Jan 26 19:11:46.913910 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:11:46.914167 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsi session list stdout=tcp: [14] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da (non-flash) Jan 26 19:11:46.914167 np0005596550.novalocal nova-compute[189076]: tcp: [15] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b (non-flash) Jan 26 19:11:46.914167 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:11:46.914544 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Resulting device map defaultdict(. at 0x7fd768199da0>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da'): ({'sda'}, set())}) {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:11:46.914730 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Removing single pathed devices sda {{(pid=189076) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:11:46.915790 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:46.921660 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[d913ad67-219e-455f-9790-9f0d52b8df7e]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d913ad67-219e-455f-9790-9f0d52b8df7e]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:46.924660 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Flushing IO for device /dev/sda {{(pid=189076) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:11:46.925969 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sda {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:46.933567 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sda" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:46.933732 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d8f319-f188-4043-90d7-943ca9cd9120]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:46.934116 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Remove SCSI device /dev/sda with /sys/block/sda/device/delete {{(pid=189076) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:11:46.934817 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sda/device/delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:46.980229 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sda/device/delete" returned: 0 in 0.043s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:46.980344 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a9309c-8ae3-4e8b-818d-aa8c1445b0ef]: (4, ('1', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:46.980708 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Checking to see if SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:11:46.980900 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:11:46.981352 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da')] {{(pid=189076) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:11:46.984089 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:46.994540 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:46.994540 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cdfe7a-6093-4570-b68a-1876b02a3273]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:46.994845 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:46.995702 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --logout {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:47.028192 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --logout" returned: 0 in 0.032s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:47.029196 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec14fd4-7de2-4b06-b0a0-6d3e87c60bc5]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da, portal: 38.102.83.18,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:47.029574 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da, portal: 38.102.83.18,3260] Jan 26 19:11:47.029574 np0005596550.novalocal nova-compute[189076]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da, portal: 38.102.83.18,3260] successful. Jan 26 19:11:47.029574 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:47.030392 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:47.043049 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4e3fe1e3-916c-4c11-b288-1ca6609a25da -p 38.102.83.18:3260 --op delete" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:47.043667 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f26bbf-72f4-4727-a7a0-5c40a39fb7a6]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:47.044075 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:47.044473 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.164s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:11:47.044689 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] <== disconnect_volume: return (163ms) None {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:11:47.044938 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Disconnected iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jan 26 19:11:47.045262 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Deleting instance files /opt/stack/data/nova/instances/e644873b-9046-4305-bda6-e6b01555c047_del Jan 26 19:11:47.045840 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Deletion of /opt/stack/data/nova/instances/e644873b-9046-4305-bda6-e6b01555c047_del complete Jan 26 19:11:47.274569 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:47.560817 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Took 1.50 seconds to destroy the instance on the hypervisor. Jan 26 19:11:47.560817 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:11:47.561488 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: e644873b-9046-4305-bda6-e6b01555c047] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:11:47.562925 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: e644873b-9046-4305-bda6-e6b01555c047] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:11:47.565803 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:11:47.614799 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:47.671180 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:11:48.169694 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e15e0906-bb4e-4d82-925e-6972b3b63781 req-437ff3d5-9925-4fb1-b056-ed047b344123 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Received event network-vif-deleted-6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:11:48.170183 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-e15e0906-bb4e-4d82-925e-6972b3b63781 req-437ff3d5-9925-4fb1-b056-ed047b344123 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Neutron deleted interface 6f62e7be-24d4-4385-85c3-ad547148947c; detaching it from the instance and deleting it from the info cache Jan 26 19:11:48.170183 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-e15e0906-bb4e-4d82-925e-6972b3b63781 req-437ff3d5-9925-4fb1-b056-ed047b344123 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:11:48.427123 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-57bf8f09-6805-4bb0-a72d-6e3ae537ad1b req-b79ffc54-3184-433e-8525-ddbf863706f6 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Received event network-vif-unplugged-6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:11:48.427708 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-57bf8f09-6805-4bb0-a72d-6e3ae537ad1b req-b79ffc54-3184-433e-8525-ddbf863706f6 service nova] Acquiring lock "e644873b-9046-4305-bda6-e6b01555c047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:48.428255 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-57bf8f09-6805-4bb0-a72d-6e3ae537ad1b req-b79ffc54-3184-433e-8525-ddbf863706f6 service nova] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:48.428577 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-57bf8f09-6805-4bb0-a72d-6e3ae537ad1b req-b79ffc54-3184-433e-8525-ddbf863706f6 service nova] Lock "e644873b-9046-4305-bda6-e6b01555c047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:48.428918 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-57bf8f09-6805-4bb0-a72d-6e3ae537ad1b req-b79ffc54-3184-433e-8525-ddbf863706f6 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] No waiting events found dispatching network-vif-unplugged-6f62e7be-24d4-4385-85c3-ad547148947c {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:11:48.429491 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-57bf8f09-6805-4bb0-a72d-6e3ae537ad1b req-b79ffc54-3184-433e-8525-ddbf863706f6 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Received event network-vif-unplugged-6f62e7be-24d4-4385-85c3-ad547148947c for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:11:48.641670 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: e644873b-9046-4305-bda6-e6b01555c047] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:11:48.674464 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e15e0906-bb4e-4d82-925e-6972b3b63781 req-437ff3d5-9925-4fb1-b056-ed047b344123 service nova] [instance: e644873b-9046-4305-bda6-e6b01555c047] Detach interface failed, port_id=6f62e7be-24d4-4385-85c3-ad547148947c, reason: Instance e644873b-9046-4305-bda6-e6b01555c047 could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:11:49.144499 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: e644873b-9046-4305-bda6-e6b01555c047] Took 1.58 seconds to deallocate network for instance. Jan 26 19:11:49.976160 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:11:49.976160 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] VM Stopped (Lifecycle Event) Jan 26 19:11:49.985261 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Acquiring lock "295123b2-57e9-4b0d-af2d-70b35167f85e" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:49.988725 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:50.481933 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-70fce614-2989-49c7-955c-093f69cb6a3d None None] [instance: 0da3ba5a-4d62-4ee6-a318-a93ddc4353cd] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:11:50.489667 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:11:51.031169 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:51.031660 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:51.034797 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:11:51.034797 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Claim successful on node np0005596550.novalocal Jan 26 19:11:51.871522 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:52.173179 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:11:52.192444 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Took 3.05 seconds to detach 1 volumes for instance. Jan 26 19:11:52.195806 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] [instance: e644873b-9046-4305-bda6-e6b01555c047] Deleting volume: 4e3fe1e3-916c-4c11-b288-1ca6609a25da {{(pid=189076) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3343}} Jan 26 19:11:52.663290 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:52.679547 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:11:52.761457 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:53.195100 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.163s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:53.195708 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:11:53.198275 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.437s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:53.345043 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:11:53.704385 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:11:53.704578 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:11:53.706267 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:11:53.706758 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:11:53.759981 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd1ad7e0e2a844767a6a58b19724cbd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10cba04043c48658cbbee662762e008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:11:53.848254 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:11:54.221339 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:11:54.301973 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Successfully created port: cc5b7109-a943-4e78-88d8-b227cad663ea {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:11:54.354914 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.155s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:54.407896 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Deleted allocations for instance e644873b-9046-4305-bda6-e6b01555c047 Jan 26 19:11:54.727455 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:11:54.739845 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Successfully updated port: cc5b7109-a943-4e78-88d8-b227cad663ea {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:11:54.770643 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5e0f0f57-ae41-497e-89c4-88f69be63761 req-058c7296-d8d6-400f-b406-1dd7d5465e20 service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Received event network-changed-cc5b7109-a943-4e78-88d8-b227cad663ea {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:11:54.770877 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5e0f0f57-ae41-497e-89c4-88f69be63761 req-058c7296-d8d6-400f-b406-1dd7d5465e20 service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Refreshing instance network info cache due to event network-changed-cc5b7109-a943-4e78-88d8-b227cad663ea. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:11:54.771117 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5e0f0f57-ae41-497e-89c4-88f69be63761 req-058c7296-d8d6-400f-b406-1dd7d5465e20 service nova] Acquiring lock "refresh_cache-295123b2-57e9-4b0d-af2d-70b35167f85e" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:11:54.771300 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5e0f0f57-ae41-497e-89c4-88f69be63761 req-058c7296-d8d6-400f-b406-1dd7d5465e20 service nova] Acquired lock "refresh_cache-295123b2-57e9-4b0d-af2d-70b35167f85e" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:11:54.771506 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-5e0f0f57-ae41-497e-89c4-88f69be63761 req-058c7296-d8d6-400f-b406-1dd7d5465e20 service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Refreshing network info cache for port cc5b7109-a943-4e78-88d8-b227cad663ea {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:11:55.242339 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Acquiring lock "refresh_cache-295123b2-57e9-4b0d-af2d-70b35167f85e" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:11:55.274271 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-5e0f0f57-ae41-497e-89c4-88f69be63761 req-058c7296-d8d6-400f-b406-1dd7d5465e20 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:11:55.343644 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-5e0f0f57-ae41-497e-89c4-88f69be63761 req-058c7296-d8d6-400f-b406-1dd7d5465e20 service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:11:55.436793 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6bcd0ae3-e821-47dd-93b5-f4c2934ce451 tempest-ServerActionsV293TestJSON-1845614456 tempest-ServerActionsV293TestJSON-1845614456-project-member] Lock "e644873b-9046-4305-bda6-e6b01555c047" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 9.889s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:55.468354 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-5e0f0f57-ae41-497e-89c4-88f69be63761 req-058c7296-d8d6-400f-b406-1dd7d5465e20 service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:11:55.741002 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:11:55.741848 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:11:55.742107 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Creating image(s) Jan 26 19:11:55.742531 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Acquiring lock "/opt/stack/data/nova/instances/295123b2-57e9-4b0d-af2d-70b35167f85e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:55.742738 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "/opt/stack/data/nova/instances/295123b2-57e9-4b0d-af2d-70b35167f85e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:55.743270 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "/opt/stack/data/nova/instances/295123b2-57e9-4b0d-af2d-70b35167f85e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:55.743868 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:11:55.747309 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:11:55.748646 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:55.837238 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.088s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:55.837708 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:55.838248 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:55.838856 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:11:55.846523 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:11:55.848149 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:55.919243 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.072s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:55.919681 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/295123b2-57e9-4b0d-af2d-70b35167f85e/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:55.958336 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/295123b2-57e9-4b0d-af2d-70b35167f85e/disk 1073741824" returned: 0 in 0.038s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:55.958735 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.120s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:55.959107 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:55.972304 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5e0f0f57-ae41-497e-89c4-88f69be63761 req-058c7296-d8d6-400f-b406-1dd7d5465e20 service nova] Releasing lock "refresh_cache-295123b2-57e9-4b0d-af2d-70b35167f85e" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:11:55.975820 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Acquired lock "refresh_cache-295123b2-57e9-4b0d-af2d-70b35167f85e" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:11:55.975820 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:11:56.034520 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.073s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:56.034520 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Checking if we can resize image /opt/stack/data/nova/instances/295123b2-57e9-4b0d-af2d-70b35167f85e/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:11:56.034520 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/295123b2-57e9-4b0d-af2d-70b35167f85e/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:56.108892 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/295123b2-57e9-4b0d-af2d-70b35167f85e/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:56.108892 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Cannot resize image /opt/stack/data/nova/instances/295123b2-57e9-4b0d-af2d-70b35167f85e/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:11:56.109058 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:11:56.109183 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Ensure instance console log exists: /opt/stack/data/nova/instances/295123b2-57e9-4b0d-af2d-70b35167f85e/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:11:56.109471 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:56.109694 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:56.109890 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:56.563787 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:11:56.682104 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:11:56.778755 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Updating instance_info_cache with network_info: [{"id": "cc5b7109-a943-4e78-88d8-b227cad663ea", "address": "fa:16:3e:64:d9:5d", "network": {"id": "1bb29ea3-f12e-4ae7-9373-18004c925377", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46476615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10cba04043c48658cbbee662762e008", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5b7109-a9", "ovs_interfaceid": "cc5b7109-a943-4e78-88d8-b227cad663ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:11:56.910556 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:57.235911 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:57.281714 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Releasing lock "refresh_cache-295123b2-57e9-4b0d-af2d-70b35167f85e" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:11:57.282595 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Instance network_info: |[{"id": "cc5b7109-a943-4e78-88d8-b227cad663ea", "address": "fa:16:3e:64:d9:5d", "network": {"id": "1bb29ea3-f12e-4ae7-9373-18004c925377", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46476615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10cba04043c48658cbbee662762e008", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5b7109-a9", "ovs_interfaceid": "cc5b7109-a943-4e78-88d8-b227cad663ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:11:57.285072 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Start _get_guest_xml network_info=[{"id": "cc5b7109-a943-4e78-88d8-b227cad663ea", "address": "fa:16:3e:64:d9:5d", "network": {"id": "1bb29ea3-f12e-4ae7-9373-18004c925377", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46476615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10cba04043c48658cbbee662762e008", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5b7109-a9", "ovs_interfaceid": "cc5b7109-a943-4e78-88d8-b227cad663ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:11:57.290727 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:11:57.291942 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1847419248', uuid='295123b2-57e9-4b0d-af2d-70b35167f85e'), owner=OwnerMeta(userid='d1ad7e0e2a844767a6a58b19724cbd46', username='tempest-AttachVolumeTestJSON-122772367-project-member', projectid='e10cba04043c48658cbbee662762e008', projectname='tempest-AttachVolumeTestJSON-122772367'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cc5b7109-a943-4e78-88d8-b227cad663ea", "address": "fa:16:3e:64:d9:5d", "network": {"id": "1bb29ea3-f12e-4ae7-9373-18004c925377", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46476615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10cba04043c48658cbbee662762e008", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5b7109-a9", "ovs_interfaceid": "cc5b7109-a943-4e78-88d8-b227cad663ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472717.2914622) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:11:57.294376 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:11:57.294723 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:11:57.299810 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:11:57.300180 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:11:57.301096 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:11:57.301417 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:11:57.301583 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:11:57.301708 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:11:57.301882 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:11:57.302049 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:11:57.302174 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:11:57.302405 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:11:57.302544 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:11:57.302683 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:11:57.302844 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:11:57.303023 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:11:57.305745 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:11:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1847419248',display_name='tempest-AttachVolumeTestJSON-server-1847419248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-attachvolumetestjson-server-1847419248',id=87,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjIx72cGhWreJ9aMCJ+fBQesmw+C4CWR414emjxuHG0Q3DEScFjUPGXvofUmC+Yy0Pudq4f8SK638hrVj3CzKz+Gpicl6vJaZPvnAjOcGg7DaZWWaASKylgWyZks/AesQ==',key_name='tempest-keypair-622269626',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10cba04043c48658cbbee662762e008',ramdisk_id='',reservation_id='r-75nsvojv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-122772367',owner_user_name='tempest-AttachVolumeTestJSON-122772367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:11:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1ad7e0e2a844767a6a58b19724cbd46',uuid=295123b2-57e9-4b0d-af2d-70b35167f85e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc5b7109-a943-4e78-88d8-b227cad663ea", "address": "fa:16:3e:64:d9:5d", "network": {"id": "1bb29ea3-f12e-4ae7-9373-18004c925377", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46476615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10cba04043c48658cbbee662762e008", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5b7109-a9", "ovs_interfaceid": "cc5b7109-a943-4e78-88d8-b227cad663ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:11:57.306080 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Converting VIF {"id": "cc5b7109-a943-4e78-88d8-b227cad663ea", "address": "fa:16:3e:64:d9:5d", "network": {"id": "1bb29ea3-f12e-4ae7-9373-18004c925377", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46476615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10cba04043c48658cbbee662762e008", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5b7109-a9", "ovs_interfaceid": "cc5b7109-a943-4e78-88d8-b227cad663ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:11:57.306578 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:d9:5d,bridge_name='br-int',has_traffic_filtering=True,id=cc5b7109-a943-4e78-88d8-b227cad663ea,network=Network(1bb29ea3-f12e-4ae7-9373-18004c925377),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc5b7109-a9') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:11:57.307108 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lazy-loading 'pci_devices' on Instance uuid 295123b2-57e9-4b0d-af2d-70b35167f85e {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] End _get_guest_xml xml= Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: 295123b2-57e9-4b0d-af2d-70b35167f85e Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: instance-00000057 Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: tempest-AttachVolumeTestJSON-server-1847419248 Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:11:57 Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: tempest-AttachVolumeTestJSON-122772367-project-member Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: tempest-AttachVolumeTestJSON-122772367 Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: 295123b2-57e9-4b0d-af2d-70b35167f85e Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: 295123b2-57e9-4b0d-af2d-70b35167f85e Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: Jan 26 19:11:57.813140 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:11:57.818277 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Preparing to wait for external event network-vif-plugged-cc5b7109-a943-4e78-88d8-b227cad663ea {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:11:57.818277 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Acquiring lock "295123b2-57e9-4b0d-af2d-70b35167f85e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:11:57.818277 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:11:57.818277 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:11:57.818277 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:11:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1847419248',display_name='tempest-AttachVolumeTestJSON-server-1847419248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-attachvolumetestjson-server-1847419248',id=87,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjIx72cGhWreJ9aMCJ+fBQesmw+C4CWR414emjxuHG0Q3DEScFjUPGXvofUmC+Yy0Pudq4f8SK638hrVj3CzKz+Gpicl6vJaZPvnAjOcGg7DaZWWaASKylgWyZks/AesQ==',key_name='tempest-keypair-622269626',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10cba04043c48658cbbee662762e008',ramdisk_id='',reservation_id='r-75nsvojv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-122772367',owner_user_name='tempest-AttachVolumeTestJSON-122772367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:11:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1ad7e0e2a844767a6a58b19724cbd46',uuid=295123b2-57e9-4b0d-af2d-70b35167f85e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc5b7109-a943-4e78-88d8-b227cad663ea", "address": "fa:16:3e:64:d9:5d", "network": {"id": "1bb29ea3-f12e-4ae7-9373-18004c925377", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46476615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10cba04043c48658cbbee662762e008", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5b7109-a9", "ovs_interfaceid": "cc5b7109-a943-4e78-88d8-b227cad663ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:11:57.820285 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Converting VIF {"id": "cc5b7109-a943-4e78-88d8-b227cad663ea", "address": "fa:16:3e:64:d9:5d", "network": {"id": "1bb29ea3-f12e-4ae7-9373-18004c925377", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46476615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10cba04043c48658cbbee662762e008", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5b7109-a9", "ovs_interfaceid": "cc5b7109-a943-4e78-88d8-b227cad663ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:11:57.820285 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:d9:5d,bridge_name='br-int',has_traffic_filtering=True,id=cc5b7109-a943-4e78-88d8-b227cad663ea,network=Network(1bb29ea3-f12e-4ae7-9373-18004c925377),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc5b7109-a9') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:11:57.820285 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:d9:5d,bridge_name='br-int',has_traffic_filtering=True,id=cc5b7109-a943-4e78-88d8-b227cad663ea,network=Network(1bb29ea3-f12e-4ae7-9373-18004c925377),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc5b7109-a9') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:11:57.820285 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:57.820285 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:11:57.820285 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:11:57.820285 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:57.820285 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'abce291f-63dc-53f5-beb8-1c6f83fb2c8f', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:11:57.822330 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:57.822567 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:57.827805 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:57.827805 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc5b7109-a9, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:11:57.827805 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc5b7109-a9, col_values=(('qos', UUID('30233e07-423a-48c6-90d5-74a97ca066c2')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:11:57.827805 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc5b7109-a9, col_values=(('external_ids', {'iface-id': 'cc5b7109-a943-4e78-88d8-b227cad663ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:d9:5d', 'vm-uuid': '295123b2-57e9-4b0d-af2d-70b35167f85e'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:11:57.835426 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:11:57.838796 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:11:57.840068 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:d9:5d,bridge_name='br-int',has_traffic_filtering=True,id=cc5b7109-a943-4e78-88d8-b227cad663ea,network=Network(1bb29ea3-f12e-4ae7-9373-18004c925377),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc5b7109-a9') Jan 26 19:11:59.368141 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:11:59.368476 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:11:59.368476 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] No VIF found with MAC fa:16:3e:64:d9:5d, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:11:59.370858 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Using config drive Jan 26 19:11:59.883194 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:11:59.997522 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Creating config drive at /opt/stack/data/nova/instances/295123b2-57e9-4b0d-af2d-70b35167f85e/disk.config Jan 26 19:12:00.003112 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/295123b2-57e9-4b0d-af2d-70b35167f85e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpd5yj5wwf {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:00.132120 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/295123b2-57e9-4b0d-af2d-70b35167f85e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpd5yj5wwf" returned: 0 in 0.129s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:00.213304 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:00.225087 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:00.387475 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:12:00.388837 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] VM Started (Lifecycle Event) Jan 26 19:12:00.410246 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-075d701d-30b1-4a4c-b04c-86de3eac8bb2 req-61305176-7288-493b-a628-1f214e444a91 service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Received event network-vif-plugged-cc5b7109-a943-4e78-88d8-b227cad663ea {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:12:00.410695 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-075d701d-30b1-4a4c-b04c-86de3eac8bb2 req-61305176-7288-493b-a628-1f214e444a91 service nova] Acquiring lock "295123b2-57e9-4b0d-af2d-70b35167f85e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:00.411038 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-075d701d-30b1-4a4c-b04c-86de3eac8bb2 req-61305176-7288-493b-a628-1f214e444a91 service nova] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:00.411103 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-075d701d-30b1-4a4c-b04c-86de3eac8bb2 req-61305176-7288-493b-a628-1f214e444a91 service nova] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:00.411258 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-075d701d-30b1-4a4c-b04c-86de3eac8bb2 req-61305176-7288-493b-a628-1f214e444a91 service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Processing event network-vif-plugged-cc5b7109-a943-4e78-88d8-b227cad663ea {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:12:00.412450 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:12:00.417436 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:12:00.423495 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Instance spawned successfully. Jan 26 19:12:00.423577 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:12:00.539155 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:00.543326 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:00.544635 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:00.547776 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:00.549664 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:00.892703 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:12:00.895672 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:12:00.933559 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:12:00.933559 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:12:00.934114 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:12:00.934467 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:12:00.935123 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:12:00.935522 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:12:01.280573 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:01.354997 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:12:01.355156 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: e644873b-9046-4305-bda6-e6b01555c047] VM Stopped (Lifecycle Event) Jan 26 19:12:01.402372 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:12:01.402965 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:12:01.402965 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] VM Paused (Lifecycle Event) Jan 26 19:12:01.442423 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Took 5.70 seconds to spawn the instance on the hypervisor. Jan 26 19:12:01.442654 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:12:01.863835 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c48fdb39-4c8c-446a-859b-c3b91df59c70 None None] [instance: e644873b-9046-4305-bda6-e6b01555c047] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:12:01.906265 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:12:01.909194 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:12:01.909344 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] VM Resumed (Lifecycle Event) Jan 26 19:12:01.957507 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Took 10.96 seconds to build instance. Jan 26 19:12:02.411919 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:12:02.418403 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:12:02.461937 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ef53bb4-0ad8-4412-b486-ba8302c3902f tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 12.475s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:02.463022 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b5f8e649-5740-4798-891b-4b8013e79473 req-19d8edb3-d0aa-4212-8778-ef90317b6839 service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Received event network-vif-plugged-cc5b7109-a943-4e78-88d8-b227cad663ea {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:12:02.463171 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b5f8e649-5740-4798-891b-4b8013e79473 req-19d8edb3-d0aa-4212-8778-ef90317b6839 service nova] Acquiring lock "295123b2-57e9-4b0d-af2d-70b35167f85e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:02.463374 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b5f8e649-5740-4798-891b-4b8013e79473 req-19d8edb3-d0aa-4212-8778-ef90317b6839 service nova] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:02.463506 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b5f8e649-5740-4798-891b-4b8013e79473 req-19d8edb3-d0aa-4212-8778-ef90317b6839 service nova] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:02.463676 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b5f8e649-5740-4798-891b-4b8013e79473 req-19d8edb3-d0aa-4212-8778-ef90317b6839 service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] No waiting events found dispatching network-vif-plugged-cc5b7109-a943-4e78-88d8-b227cad663ea {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:12:02.464840 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-b5f8e649-5740-4798-891b-4b8013e79473 req-19d8edb3-d0aa-4212-8778-ef90317b6839 service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Received unexpected event network-vif-plugged-cc5b7109-a943-4e78-88d8-b227cad663ea for instance with vm_state active and task_state None. Jan 26 19:12:02.717155 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:02.830683 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:03.235558 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:04.107540 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b4e3e31e-b466-4fe6-a20e-8862854f8d2d req-273ab696-f7e2-4b5d-a7ed-697ac3a44982 service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Received event network-changed-cc5b7109-a943-4e78-88d8-b227cad663ea {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:12:04.107890 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b4e3e31e-b466-4fe6-a20e-8862854f8d2d req-273ab696-f7e2-4b5d-a7ed-697ac3a44982 service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Refreshing instance network info cache due to event network-changed-cc5b7109-a943-4e78-88d8-b227cad663ea. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:12:04.107920 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b4e3e31e-b466-4fe6-a20e-8862854f8d2d req-273ab696-f7e2-4b5d-a7ed-697ac3a44982 service nova] Acquiring lock "refresh_cache-295123b2-57e9-4b0d-af2d-70b35167f85e" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:12:04.108059 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b4e3e31e-b466-4fe6-a20e-8862854f8d2d req-273ab696-f7e2-4b5d-a7ed-697ac3a44982 service nova] Acquired lock "refresh_cache-295123b2-57e9-4b0d-af2d-70b35167f85e" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:12:04.108204 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-b4e3e31e-b466-4fe6-a20e-8862854f8d2d req-273ab696-f7e2-4b5d-a7ed-697ac3a44982 service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Refreshing network info cache for port cc5b7109-a943-4e78-88d8-b227cad663ea {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:12:04.611882 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-b4e3e31e-b466-4fe6-a20e-8862854f8d2d req-273ab696-f7e2-4b5d-a7ed-697ac3a44982 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:12:04.906808 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-b4e3e31e-b466-4fe6-a20e-8862854f8d2d req-273ab696-f7e2-4b5d-a7ed-697ac3a44982 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:12:05.027592 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-b4e3e31e-b466-4fe6-a20e-8862854f8d2d req-273ab696-f7e2-4b5d-a7ed-697ac3a44982 service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Updated VIF entry in instance network info cache for port cc5b7109-a943-4e78-88d8-b227cad663ea. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:12:05.027901 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-b4e3e31e-b466-4fe6-a20e-8862854f8d2d req-273ab696-f7e2-4b5d-a7ed-697ac3a44982 service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Updating instance_info_cache with network_info: [{"id": "cc5b7109-a943-4e78-88d8-b227cad663ea", "address": "fa:16:3e:64:d9:5d", "network": {"id": "1bb29ea3-f12e-4ae7-9373-18004c925377", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46476615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10cba04043c48658cbbee662762e008", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5b7109-a9", "ovs_interfaceid": "cc5b7109-a943-4e78-88d8-b227cad663ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:12:05.421340 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Acquiring lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:05.421822 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:05.530670 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b4e3e31e-b466-4fe6-a20e-8862854f8d2d req-273ab696-f7e2-4b5d-a7ed-697ac3a44982 service nova] Releasing lock "refresh_cache-295123b2-57e9-4b0d-af2d-70b35167f85e" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:12:05.925345 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:12:06.476682 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:06.477088 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:06.481468 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:12:06.481703 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Claim successful on node np0005596550.novalocal Jan 26 19:12:07.620874 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:12:07.753056 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:07.832294 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:08.125039 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:12:08.440294 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:08.440675 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:08.635519 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.158s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:08.636493 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:12:08.946448 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Detaching volume 7b99cea9-3a13-452e-9141-efcbb218f28b Jan 26 19:12:09.030936 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.block_device [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Attempting to driver detach volume 7b99cea9-3a13-452e-9141-efcbb218f28b from mountpoint /dev/vdb Jan 26 19:12:09.041589 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Found disk vdb by alias ua-7b99cea9-3a13-452e-9141-efcbb218f28b {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:12:09.043532 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Found disk vdb by alias ua-7b99cea9-3a13-452e-9141-efcbb218f28b {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:12:09.043870 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Attempting to detach device vdb from instance d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f from the persistent domain config. {{(pid=189076) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2599}} Jan 26 19:12:09.044348 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] detach device xml: Jan 26 19:12:09.044348 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:09.044348 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:09.044348 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:09.044348 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:09.044348 np0005596550.novalocal nova-compute[189076]: 7b99cea9-3a13-452e-9141-efcbb218f28b Jan 26 19:12:09.044348 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:12:09.044348 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:09.044348 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:12:09.060196 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Found disk vdb by alias ua-7b99cea9-3a13-452e-9141-efcbb218f28b {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:12:09.060424 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Failed to detach device vdb from instance d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f from the persistent domain config. Libvirt did not report any error but the device is still in the config. Jan 26 19:12:09.060586 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] (1/8): Attempting to detach device vdb with device alias ua-7b99cea9-3a13-452e-9141-efcbb218f28b from instance d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f from the live domain config. {{(pid=189076) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2633}} Jan 26 19:12:09.060956 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] detach device xml: Jan 26 19:12:09.060956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:09.060956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:09.060956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:09.060956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:09.060956 np0005596550.novalocal nova-compute[189076]: 7b99cea9-3a13-452e-9141-efcbb218f28b Jan 26 19:12:09.060956 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:12:09.060956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:09.060956 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:12:09.144587 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:12:09.144718 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:12:09.145000 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:12:09.145247 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:12:09.211642 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Received event ua-7b99cea9-3a13-452e-9141-efcbb218f28b> from libvirt while the driver is waiting for it; dispatched. {{(pid=189076) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2486}} Jan 26 19:12:09.213815 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7b99cea9-3a13-452e-9141-efcbb218f28b for instance d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f {{(pid=189076) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2713}} Jan 26 19:12:09.217452 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Successfully detached device vdb from instance d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f from the live domain config. Jan 26 19:12:09.219164 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] calling os-brick to detach iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jan 26 19:12:09.220405 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b', 'target_lun': 0, 'volume_id': '7b99cea9-3a13-452e-9141-efcbb218f28b', 'auth_method': 'CHAP', 'auth_username': 'xAMSGov4NR4iBpfuFrd8', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:12:09.221180 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:12:09.225172 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:12:09.227539 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:09.235657 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:09.235945 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1041203-9976-4efd-b730-a44afe8e97f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:09.236306 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:12:09.236306 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:12:09.236306 np0005596550.novalocal nova-compute[189076]: iSNS: Jan 26 19:12:09.236306 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:12:09.236306 np0005596550.novalocal nova-compute[189076]: STATIC: Jan 26 19:12:09.236306 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b Jan 26 19:12:09.236306 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:12:09.236306 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:12:09.236306 np0005596550.novalocal nova-compute[189076]: FIRMWARE: Jan 26 19:12:09.236306 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:12:09.236306 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:12:09.236535 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:12:09.236535 np0005596550.novalocal nova-compute[189076]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:12:09.236535 np0005596550.novalocal nova-compute[189076]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=189076) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:12:09.236926 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b', 0)] {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:12:09.240200 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:09.246836 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.006s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:09.247076 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[67897549-b4d8-4959-abfa-c018138acfb7]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:09.247760 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:09.256862 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:09.258220 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5da771-91c8-4624-83ab-3474bc156c28]: (4, ('tcp: [15] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:09.258555 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b (non-flash) Jan 26 19:12:09.258555 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:12:09.258707 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsi session list stdout=tcp: [15] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b (non-flash) Jan 26 19:12:09.258707 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:12:09.259235 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Resulting device map defaultdict(. at 0x7fd7680898a0>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b'): ({'sdb'}, set())}) {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:12:09.259427 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Removing single pathed devices sdb {{(pid=189076) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:12:09.259984 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:09.264203 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:12:09.266754 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[3b03c408-a4c0-4e2b-ab33-a5fae168a1f2]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:12:09.266754 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:12:09.266754 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:12:09.266754 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:12:09.266754 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:09.266754 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:12:09.266754 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:12:09.266754 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:09.266754 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:12:09.266754 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:12:09.266754 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:09.266754 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:12:09.266754 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:12:09.266754 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:09.266754 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:12:09.266754 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:12:09.266754 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:09.266754 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:12:09.266754 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:12:09.266754 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:12:09.266754 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:12:09.266754 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:12:09.268858 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b03c408-a4c0-4e2b-ab33-a5fae168a1f2]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:09.269363 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Flushing IO for device /dev/sdb {{(pid=189076) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:12:09.269861 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:09.273208 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'afcecc63273f4bfda195a472998c466e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b3e91a089648cf8ca8f046abf927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:12:09.285221 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.005s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:09.285384 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8a7a66-e29e-48a5-a6fd-ab3212c5864b]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:09.287454 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=189076) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:12:09.289245 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:09.339611 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:09.339726 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c22438c-eb8e-4e5f-8082-63446e7da5ff]: (4, ('1', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:09.340109 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:12:09.340281 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] SCSI volumes sdb have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:12:09.340528 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b')] {{(pid=189076) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:12:09.341373 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:09.358539 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:09.358539 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39975f9-fa76-4399-aa47-af78bb5f7fb9]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:09.358539 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:09.360029 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260 --logout {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:09.388952 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260 --logout" returned: 0 in 0.028s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:09.388952 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60f8dfe-e5e6-4ccf-a896-dc8817b77cfc]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b, portal: 38.102.83.18,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:09.388952 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b, portal: 38.102.83.18,3260] Jan 26 19:12:09.388952 np0005596550.novalocal nova-compute[189076]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b, portal: 38.102.83.18,3260] successful. Jan 26 19:12:09.388952 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:09.393163 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260 --op delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:09.400894 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b -p 38.102.83.18:3260 --op delete" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:09.401116 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[be97af38-55be-47f6-988c-c33eef74ca71]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:09.402388 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:09.402784 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.181s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:12:09.404013 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] <== disconnect_volume: return (183ms) None {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:12:09.404265 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Disconnected iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jan 26 19:12:09.702448 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:12:09.754146 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Successfully created port: 82e239ac-e0e4-44e8-8a67-ddd602e91c7d {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:12:10.212367 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:12:10.245437 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Successfully updated port: 82e239ac-e0e4-44e8-8a67-ddd602e91c7d {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:12:10.310321 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-97ca1d89-3d51-4e03-b678-e228ad789464 req-dc835a7c-8fa5-4577-8d12-a254dba51d0c service nova] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Received event network-changed-82e239ac-e0e4-44e8-8a67-ddd602e91c7d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:12:10.310549 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-97ca1d89-3d51-4e03-b678-e228ad789464 req-dc835a7c-8fa5-4577-8d12-a254dba51d0c service nova] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Refreshing instance network info cache due to event network-changed-82e239ac-e0e4-44e8-8a67-ddd602e91c7d. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:12:10.310725 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-97ca1d89-3d51-4e03-b678-e228ad789464 req-dc835a7c-8fa5-4577-8d12-a254dba51d0c service nova] Acquiring lock "refresh_cache-100d7d01-ce38-4e2e-ac3d-84ade2fd4605" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:12:10.310874 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-97ca1d89-3d51-4e03-b678-e228ad789464 req-dc835a7c-8fa5-4577-8d12-a254dba51d0c service nova] Acquired lock "refresh_cache-100d7d01-ce38-4e2e-ac3d-84ade2fd4605" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:12:10.311023 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-97ca1d89-3d51-4e03-b678-e228ad789464 req-dc835a7c-8fa5-4577-8d12-a254dba51d0c service nova] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Refreshing network info cache for port 82e239ac-e0e4-44e8-8a67-ddd602e91c7d {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:12:10.752470 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Acquiring lock "refresh_cache-100d7d01-ce38-4e2e-ac3d-84ade2fd4605" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:12:10.818400 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-97ca1d89-3d51-4e03-b678-e228ad789464 req-dc835a7c-8fa5-4577-8d12-a254dba51d0c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:12:10.865831 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-97ca1d89-3d51-4e03-b678-e228ad789464 req-dc835a7c-8fa5-4577-8d12-a254dba51d0c service nova] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:12:11.005619 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-97ca1d89-3d51-4e03-b678-e228ad789464 req-dc835a7c-8fa5-4577-8d12-a254dba51d0c service nova] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:12:11.226142 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:12:11.226963 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:12:11.227230 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Creating image(s) Jan 26 19:12:11.227628 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Acquiring lock "/opt/stack/data/nova/instances/100d7d01-ce38-4e2e-ac3d-84ade2fd4605/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:11.227857 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Lock "/opt/stack/data/nova/instances/100d7d01-ce38-4e2e-ac3d-84ade2fd4605/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:11.228374 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Lock "/opt/stack/data/nova/instances/100d7d01-ce38-4e2e-ac3d-84ade2fd4605/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:11.228889 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:12:11.231663 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:12:11.233575 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:11.313342 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.079s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:11.313705 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:11.314260 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:11.314559 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:12:11.317416 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:12:11.317778 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:11.394549 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.076s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:11.394953 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/100d7d01-ce38-4e2e-ac3d-84ade2fd4605/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:11.451728 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/100d7d01-ce38-4e2e-ac3d-84ade2fd4605/disk 1073741824" returned: 0 in 0.056s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:11.451728 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.137s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:11.451728 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:11.509167 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-97ca1d89-3d51-4e03-b678-e228ad789464 req-dc835a7c-8fa5-4577-8d12-a254dba51d0c service nova] Releasing lock "refresh_cache-100d7d01-ce38-4e2e-ac3d-84ade2fd4605" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:12:11.509651 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Acquired lock "refresh_cache-100d7d01-ce38-4e2e-ac3d-84ade2fd4605" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:12:11.509858 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:12:11.555855 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.104s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:11.556404 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/100d7d01-ce38-4e2e-ac3d-84ade2fd4605/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:12:11.556924 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100d7d01-ce38-4e2e-ac3d-84ade2fd4605/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:11.651515 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100d7d01-ce38-4e2e-ac3d-84ade2fd4605/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:11.652240 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Cannot resize image /opt/stack/data/nova/instances/100d7d01-ce38-4e2e-ac3d-84ade2fd4605/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:12:11.653228 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:12:11.653655 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Ensure instance console log exists: /opt/stack/data/nova/instances/100d7d01-ce38-4e2e-ac3d-84ade2fd4605/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:12:11.654312 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:11.654784 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:11.655161 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:12.089602 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:12:12.233938 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:12:12.354865 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Updating instance_info_cache with network_info: [{"id": "82e239ac-e0e4-44e8-8a67-ddd602e91c7d", "address": "fa:16:3e:b0:d5:3c", "network": {"id": "3cc7944a-7869-42f0-9bdc-9f7a2df385eb", "bridge": "br-int", "label": "tempest-ServerAddressesTestJSON-1465657991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "41b3e91a089648cf8ca8f046abf927a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82e239ac-e0", "ovs_interfaceid": "82e239ac-e0e4-44e8-8a67-ddd602e91c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:12:12.457251 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lazy-loading 'flavor' on Instance uuid d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:12:12.790108 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:12.833330 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:12.857788 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Releasing lock "refresh_cache-100d7d01-ce38-4e2e-ac3d-84ade2fd4605" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:12:12.858334 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Instance network_info: |[{"id": "82e239ac-e0e4-44e8-8a67-ddd602e91c7d", "address": "fa:16:3e:b0:d5:3c", "network": {"id": "3cc7944a-7869-42f0-9bdc-9f7a2df385eb", "bridge": "br-int", "label": "tempest-ServerAddressesTestJSON-1465657991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "41b3e91a089648cf8ca8f046abf927a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82e239ac-e0", "ovs_interfaceid": "82e239ac-e0e4-44e8-8a67-ddd602e91c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:12:12.862183 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Start _get_guest_xml network_info=[{"id": "82e239ac-e0e4-44e8-8a67-ddd602e91c7d", "address": "fa:16:3e:b0:d5:3c", "network": {"id": "3cc7944a-7869-42f0-9bdc-9f7a2df385eb", "bridge": "br-int", "label": "tempest-ServerAddressesTestJSON-1465657991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "41b3e91a089648cf8ca8f046abf927a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82e239ac-e0", "ovs_interfaceid": "82e239ac-e0e4-44e8-8a67-ddd602e91c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:12:12.866809 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:12:12.868646 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerAddressesTestJSON-server-81255324', uuid='100d7d01-ce38-4e2e-ac3d-84ade2fd4605'), owner=OwnerMeta(userid='afcecc63273f4bfda195a472998c466e', username='tempest-ServerAddressesTestJSON-410922799-project-member', projectid='41b3e91a089648cf8ca8f046abf927a8', projectname='tempest-ServerAddressesTestJSON-410922799'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "82e239ac-e0e4-44e8-8a67-ddd602e91c7d", "address": "fa:16:3e:b0:d5:3c", "network": {"id": "3cc7944a-7869-42f0-9bdc-9f7a2df385eb", "bridge": "br-int", "label": "tempest-ServerAddressesTestJSON-1465657991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "41b3e91a089648cf8ca8f046abf927a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82e239ac-e0", "ovs_interfaceid": "82e239ac-e0e4-44e8-8a67-ddd602e91c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472732.8680036) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:12:12.871198 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:12:12.871821 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:12:12.873236 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:12:12.873564 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:12:12.874408 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:12:12.874728 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:12:12.874942 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:12:12.875074 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:12:12.875262 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:12:12.875389 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:12:12.875545 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:12:12.875721 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:12:12.875874 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:12:12.876017 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:12:12.876157 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:12:12.876352 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:12:12.879251 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:12:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerAddressesTestJSON-server-81255324',display_name='tempest-ServerAddressesTestJSON-server-81255324',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveraddressestestjson-server-81255324',id=88,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41b3e91a089648cf8ca8f046abf927a8',ramdisk_id='',reservation_id='r-mj39idp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerAddressesTestJSON-410922799',owner_user_name='tempest-ServerAddressesTestJSON-410922799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:12:10Z,user_data=None,user_id='afcecc63273f4bfda195a472998c466e',uuid=100d7d01-ce38-4e2e-ac3d-84ade2fd4605,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82e239ac-e0e4-44e8-8a67-ddd602e91c7d", "address": "fa:16:3e:b0:d5:3c", "network": {"id": "3cc7944a-7869-42f0-9bdc-9f7a2df385eb", "bridge": "br-int", "label": "tempest-ServerAddressesTestJSON-1465657991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "41b3e91a089648cf8ca8f046abf927a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82e239ac-e0", "ovs_interfaceid": "82e239ac-e0e4-44e8-8a67-ddd602e91c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:12:12.879423 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Converting VIF {"id": "82e239ac-e0e4-44e8-8a67-ddd602e91c7d", "address": "fa:16:3e:b0:d5:3c", "network": {"id": "3cc7944a-7869-42f0-9bdc-9f7a2df385eb", "bridge": "br-int", "label": "tempest-ServerAddressesTestJSON-1465657991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "41b3e91a089648cf8ca8f046abf927a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82e239ac-e0", "ovs_interfaceid": "82e239ac-e0e4-44e8-8a67-ddd602e91c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:12:12.880020 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:d5:3c,bridge_name='br-int',has_traffic_filtering=True,id=82e239ac-e0e4-44e8-8a67-ddd602e91c7d,network=Network(3cc7944a-7869-42f0-9bdc-9f7a2df385eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82e239ac-e0') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:12:12.880536 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Lazy-loading 'pci_devices' on Instance uuid 100d7d01-ce38-4e2e-ac3d-84ade2fd4605 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] End _get_guest_xml xml= Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605 Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: instance-00000058 Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: tempest-ServerAddressesTestJSON-server-81255324 Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:12:12 Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: tempest-ServerAddressesTestJSON-410922799-project-member Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: tempest-ServerAddressesTestJSON-410922799 Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605 Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605 Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:13.386694 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:12:13.390041 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Preparing to wait for external event network-vif-plugged-82e239ac-e0e4-44e8-8a67-ddd602e91c7d {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:12:13.390249 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Acquiring lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:13.390612 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:13.390845 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:13.391657 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:12:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerAddressesTestJSON-server-81255324',display_name='tempest-ServerAddressesTestJSON-server-81255324',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveraddressestestjson-server-81255324',id=88,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41b3e91a089648cf8ca8f046abf927a8',ramdisk_id='',reservation_id='r-mj39idp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerAddressesTestJSON-410922799',owner_user_name='tempest-ServerAddressesTestJSON-410922799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:12:10Z,user_data=None,user_id='afcecc63273f4bfda195a472998c466e',uuid=100d7d01-ce38-4e2e-ac3d-84ade2fd4605,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82e239ac-e0e4-44e8-8a67-ddd602e91c7d", "address": "fa:16:3e:b0:d5:3c", "network": {"id": "3cc7944a-7869-42f0-9bdc-9f7a2df385eb", "bridge": "br-int", "label": "tempest-ServerAddressesTestJSON-1465657991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "41b3e91a089648cf8ca8f046abf927a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82e239ac-e0", "ovs_interfaceid": "82e239ac-e0e4-44e8-8a67-ddd602e91c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:12:13.391849 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Converting VIF {"id": "82e239ac-e0e4-44e8-8a67-ddd602e91c7d", "address": "fa:16:3e:b0:d5:3c", "network": {"id": "3cc7944a-7869-42f0-9bdc-9f7a2df385eb", "bridge": "br-int", "label": "tempest-ServerAddressesTestJSON-1465657991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "41b3e91a089648cf8ca8f046abf927a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82e239ac-e0", "ovs_interfaceid": "82e239ac-e0e4-44e8-8a67-ddd602e91c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:12:13.392510 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:d5:3c,bridge_name='br-int',has_traffic_filtering=True,id=82e239ac-e0e4-44e8-8a67-ddd602e91c7d,network=Network(3cc7944a-7869-42f0-9bdc-9f7a2df385eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82e239ac-e0') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:12:13.392642 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:d5:3c,bridge_name='br-int',has_traffic_filtering=True,id=82e239ac-e0e4-44e8-8a67-ddd602e91c7d,network=Network(3cc7944a-7869-42f0-9bdc-9f7a2df385eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82e239ac-e0') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:12:13.393296 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:13.393555 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:12:13.393822 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:12:13.394476 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:13.394649 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19723d9c-7469-5ed2-a679-9a0cd3996121', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:12:13.396071 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:13.399199 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:12:13.403282 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:13.403471 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82e239ac-e0, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:12:13.403804 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82e239ac-e0, col_values=(('qos', UUID('154b1ff7-59ac-4605-b61d-4bf41af9980a')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:12:13.404049 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82e239ac-e0, col_values=(('external_ids', {'iface-id': '82e239ac-e0e4-44e8-8a67-ddd602e91c7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:d5:3c', 'vm-uuid': '100d7d01-ce38-4e2e-ac3d-84ade2fd4605'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:12:13.405274 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:13.408205 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:12:13.413474 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:13.414294 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:d5:3c,bridge_name='br-int',has_traffic_filtering=True,id=82e239ac-e0e4-44e8-8a67-ddd602e91c7d,network=Network(3cc7944a-7869-42f0-9bdc-9f7a2df385eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82e239ac-e0') Jan 26 19:12:13.465664 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4d742ded-6e27-402a-bd00-362b0310f4e2 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 5.025s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:13.836775 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:13.837098 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:13.837423 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:13.837750 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:13.838003 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:13.840645 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Terminating instance Jan 26 19:12:14.346052 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:12:14.374727 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:14.395331 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:14.407995 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:14.498197 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-532948aa-e4ec-432d-8c2e-8ddec673f8d0 req-0c23059d-730d-49ad-9776-4f45d91ed4f0 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Received event network-vif-unplugged-4841e3d0-589b-4d89-9700-763060784597 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:12:14.498357 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-532948aa-e4ec-432d-8c2e-8ddec673f8d0 req-0c23059d-730d-49ad-9776-4f45d91ed4f0 service nova] Acquiring lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:14.498514 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-532948aa-e4ec-432d-8c2e-8ddec673f8d0 req-0c23059d-730d-49ad-9776-4f45d91ed4f0 service nova] Lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:14.498633 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-532948aa-e4ec-432d-8c2e-8ddec673f8d0 req-0c23059d-730d-49ad-9776-4f45d91ed4f0 service nova] Lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:14.498841 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-532948aa-e4ec-432d-8c2e-8ddec673f8d0 req-0c23059d-730d-49ad-9776-4f45d91ed4f0 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] No waiting events found dispatching network-vif-unplugged-4841e3d0-589b-4d89-9700-763060784597 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:12:14.498931 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-532948aa-e4ec-432d-8c2e-8ddec673f8d0 req-0c23059d-730d-49ad-9776-4f45d91ed4f0 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Received event network-vif-unplugged-4841e3d0-589b-4d89-9700-763060784597 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:12:14.571550 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:14.589920 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:14.645105 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Instance destroyed successfully. Jan 26 19:12:14.645719 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lazy-loading 'resources' on Instance uuid d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:12:14.656439 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:10:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-305096841',display_name='tempest-VolumesBackupsTest-instance-305096841',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-volumesbackupstest-instance-305096841',id=85,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEoWGA//ycCzHyCNmfjqGY67sPn/RYnPIcUiogCE5JX2MK8RVLMTgw4M8EN62b43v+gVV9Fix1Vcj0RrzONXcf1ZdBX7fw88tu15QIuXovRupgOwB4Ss7HoKAv7hmxErQ==',key_name='tempest-keypair-1567284510',keypairs=,launch_index=0,launched_at=2026-01-27T00:10:52Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='261cb1c98c954302ba86efa2ceee43f2',ramdisk_id='',reservation_id='r-ein08f7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-97611117',owner_user_name='tempest-VolumesBackupsTest-97611117-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:10:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6cbe3740f6c4303bbf3e5d5c92677db',uuid=d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4841e3d0-589b-4d89-9700-763060784597", "address": "fa:16:3e:8b:fc:cc", "network": {"id": "94b85e06-699e-4d2b-a361-6a62d99d858f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1614914474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261cb1c98c954302ba86efa2ceee43f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4841e3d0-58", "ovs_interfaceid": "4841e3d0-589b-4d89-9700-763060784597", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:12:14.656634 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Converting VIF {"id": "4841e3d0-589b-4d89-9700-763060784597", "address": "fa:16:3e:8b:fc:cc", "network": {"id": "94b85e06-699e-4d2b-a361-6a62d99d858f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1614914474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261cb1c98c954302ba86efa2ceee43f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4841e3d0-58", "ovs_interfaceid": "4841e3d0-589b-4d89-9700-763060784597", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:12:14.657108 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:fc:cc,bridge_name='br-int',has_traffic_filtering=True,id=4841e3d0-589b-4d89-9700-763060784597,network=Network(94b85e06-699e-4d2b-a361-6a62d99d858f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4841e3d0-58') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:12:14.657334 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:fc:cc,bridge_name='br-int',has_traffic_filtering=True,id=4841e3d0-589b-4d89-9700-763060784597,network=Network(94b85e06-699e-4d2b-a361-6a62d99d858f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4841e3d0-58') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:12:14.658569 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:14.658789 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4841e3d0-58, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:12:14.660367 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:14.661726 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:12:14.665873 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:14.667165 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:14.667473 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=297ca36a-9cf9-4b09-884a-e33b206ae877) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:12:14.668193 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:14.672028 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:12:14.678078 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:14.680403 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:fc:cc,bridge_name='br-int',has_traffic_filtering=True,id=4841e3d0-589b-4d89-9700-763060784597,network=Network(94b85e06-699e-4d2b-a361-6a62d99d858f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4841e3d0-58') Jan 26 19:12:14.680972 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Deleting instance files /opt/stack/data/nova/instances/d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f_del Jan 26 19:12:14.681643 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Deletion of /opt/stack/data/nova/instances/d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f_del complete Jan 26 19:12:14.861943 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:14.868757 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:14.873941 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:14.878328 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:14.882726 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:14.928104 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:14.936545 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:12:14.936545 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:12:14.936545 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] No VIF found with MAC fa:16:3e:b0:d5:3c, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:12:14.936935 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Using config drive Jan 26 19:12:14.941162 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:15.192017 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Took 0.85 seconds to destroy the instance on the hypervisor. Jan 26 19:12:15.192295 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:12:15.192490 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:12:15.192609 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:12:15.192858 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:12:15.233026 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:12:15.445108 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:12:15.615830 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Creating config drive at /opt/stack/data/nova/instances/100d7d01-ce38-4e2e-ac3d-84ade2fd4605/disk.config Jan 26 19:12:15.618274 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/100d7d01-ce38-4e2e-ac3d-84ade2fd4605/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp3sc4s4c9 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:15.673835 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-29daf13e-40ea-43ab-9a1d-14ae8399e1d7 req-6b6d5787-3a6a-4f57-a5ed-3b4b47308517 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Received event network-vif-deleted-4841e3d0-589b-4d89-9700-763060784597 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:12:15.674011 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-29daf13e-40ea-43ab-9a1d-14ae8399e1d7 req-6b6d5787-3a6a-4f57-a5ed-3b4b47308517 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Neutron deleted interface 4841e3d0-589b-4d89-9700-763060784597; detaching it from the instance and deleting it from the info cache Jan 26 19:12:15.674169 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-29daf13e-40ea-43ab-9a1d-14ae8399e1d7 req-6b6d5787-3a6a-4f57-a5ed-3b4b47308517 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:12:15.747548 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/100d7d01-ce38-4e2e-ac3d-84ade2fd4605/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp3sc4s4c9" returned: 0 in 0.129s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:15.813805 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:15.823856 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:15.829192 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:15.834568 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:16.024174 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:12:16.025620 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] VM Started (Lifecycle Event) Jan 26 19:12:16.086189 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:16.087848 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:16.091953 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:16.093452 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:16.140028 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:12:16.179016 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-29daf13e-40ea-43ab-9a1d-14ae8399e1d7 req-6b6d5787-3a6a-4f57-a5ed-3b4b47308517 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Detach interface failed, port_id=4841e3d0-589b-4d89-9700-763060784597, reason: Instance d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:12:16.532234 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:12:16.535328 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:12:16.535507 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] VM Paused (Lifecycle Event) Jan 26 19:12:16.565615 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-01642987-9a4f-49d9-8b9d-a51abda330b8 req-5829c66c-9f40-4ac8-b57c-da9c02481792 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Received event network-vif-unplugged-4841e3d0-589b-4d89-9700-763060784597 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:12:16.565796 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-01642987-9a4f-49d9-8b9d-a51abda330b8 req-5829c66c-9f40-4ac8-b57c-da9c02481792 service nova] Acquiring lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:16.565998 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-01642987-9a4f-49d9-8b9d-a51abda330b8 req-5829c66c-9f40-4ac8-b57c-da9c02481792 service nova] Lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:16.566146 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-01642987-9a4f-49d9-8b9d-a51abda330b8 req-5829c66c-9f40-4ac8-b57c-da9c02481792 service nova] Lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:16.566993 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-01642987-9a4f-49d9-8b9d-a51abda330b8 req-5829c66c-9f40-4ac8-b57c-da9c02481792 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] No waiting events found dispatching network-vif-unplugged-4841e3d0-589b-4d89-9700-763060784597 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:12:16.567146 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-01642987-9a4f-49d9-8b9d-a51abda330b8 req-5829c66c-9f40-4ac8-b57c-da9c02481792 service nova] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Received event network-vif-unplugged-4841e3d0-589b-4d89-9700-763060784597 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:12:16.567284 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-01642987-9a4f-49d9-8b9d-a51abda330b8 req-5829c66c-9f40-4ac8-b57c-da9c02481792 service nova] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Received event network-vif-plugged-82e239ac-e0e4-44e8-8a67-ddd602e91c7d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:12:16.567422 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-01642987-9a4f-49d9-8b9d-a51abda330b8 req-5829c66c-9f40-4ac8-b57c-da9c02481792 service nova] Acquiring lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:16.567565 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-01642987-9a4f-49d9-8b9d-a51abda330b8 req-5829c66c-9f40-4ac8-b57c-da9c02481792 service nova] Lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:16.567694 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-01642987-9a4f-49d9-8b9d-a51abda330b8 req-5829c66c-9f40-4ac8-b57c-da9c02481792 service nova] Lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:16.567839 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-01642987-9a4f-49d9-8b9d-a51abda330b8 req-5829c66c-9f40-4ac8-b57c-da9c02481792 service nova] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Processing event network-vif-plugged-82e239ac-e0e4-44e8-8a67-ddd602e91c7d {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:12:16.567991 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-01642987-9a4f-49d9-8b9d-a51abda330b8 req-5829c66c-9f40-4ac8-b57c-da9c02481792 service nova] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Received event network-vif-plugged-82e239ac-e0e4-44e8-8a67-ddd602e91c7d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:12:16.568122 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-01642987-9a4f-49d9-8b9d-a51abda330b8 req-5829c66c-9f40-4ac8-b57c-da9c02481792 service nova] Acquiring lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:16.568302 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-01642987-9a4f-49d9-8b9d-a51abda330b8 req-5829c66c-9f40-4ac8-b57c-da9c02481792 service nova] Lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:16.568435 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-01642987-9a4f-49d9-8b9d-a51abda330b8 req-5829c66c-9f40-4ac8-b57c-da9c02481792 service nova] Lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:16.568659 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-01642987-9a4f-49d9-8b9d-a51abda330b8 req-5829c66c-9f40-4ac8-b57c-da9c02481792 service nova] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] No waiting events found dispatching network-vif-plugged-82e239ac-e0e4-44e8-8a67-ddd602e91c7d {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:12:16.568814 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-01642987-9a4f-49d9-8b9d-a51abda330b8 req-5829c66c-9f40-4ac8-b57c-da9c02481792 service nova] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Received unexpected event network-vif-plugged-82e239ac-e0e4-44e8-8a67-ddd602e91c7d for instance with vm_state building and task_state spawning. Jan 26 19:12:16.569256 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:12:16.572305 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:12:16.576453 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Instance spawned successfully. Jan 26 19:12:16.576707 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:12:16.642751 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Took 1.45 seconds to deallocate network for instance. Jan 26 19:12:17.039281 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:12:17.041429 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:12:17.041582 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] VM Resumed (Lifecycle Event) Jan 26 19:12:17.087317 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:12:17.087611 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:12:17.088485 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:12:17.089140 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:12:17.089794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:12:17.090542 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:12:17.149446 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:17.149671 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:17.280957 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:12:17.544829 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:12:17.546763 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:12:17.598267 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Took 6.37 seconds to spawn the instance on the hypervisor. Jan 26 19:12:17.598379 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:12:17.783894 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:12:17.790883 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:17.895790 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:12:18.050725 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:12:18.108054 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Took 11.68 seconds to build instance. Jan 26 19:12:18.290392 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.139s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:18.355124 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Deleted allocations for instance d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f Jan 26 19:12:18.400331 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:18.400827 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:18.401204 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:18.401564 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:12:18.610642 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-513f3eed-78a3-4175-8a74-f9b6f006ac7c tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 13.189s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:19.319526 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Acquiring lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:19.319717 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:19.319909 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Acquiring lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:19.320107 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:19.320257 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:19.322266 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Terminating instance Jan 26 19:12:19.368215 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-89cce6a2-a6e0-4ed2-8b56-2563c93d7610 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 5.531s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:19.431443 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100d7d01-ce38-4e2e-ac3d-84ade2fd4605/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:19.518067 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100d7d01-ce38-4e2e-ac3d-84ade2fd4605/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:19.518487 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100d7d01-ce38-4e2e-ac3d-84ade2fd4605/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:19.596791 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100d7d01-ce38-4e2e-ac3d-84ade2fd4605/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:19.604711 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/295123b2-57e9-4b0d-af2d-70b35167f85e/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:19.669382 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:19.686062 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/295123b2-57e9-4b0d-af2d-70b35167f85e/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:19.686368 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/295123b2-57e9-4b0d-af2d-70b35167f85e/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:19.761114 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/295123b2-57e9-4b0d-af2d-70b35167f85e/disk --force-share --output=json" returned: 0 in 0.074s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:19.825518 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:12:19.848196 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:19.875709 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:19.878211 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:12:19.879364 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:19.891886 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:19.904912 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.025s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:19.905287 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=7623MB free_disk=373.09054946899414GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:12:19.908476 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:19.908476 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:20.052355 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b2684041-07f0-4245-a55e-c9b9e16a009f req-088bea66-f384-43d8-ba17-23a77a64c1ba service nova] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Received event network-vif-unplugged-82e239ac-e0e4-44e8-8a67-ddd602e91c7d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:12:20.052525 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b2684041-07f0-4245-a55e-c9b9e16a009f req-088bea66-f384-43d8-ba17-23a77a64c1ba service nova] Acquiring lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:20.052698 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b2684041-07f0-4245-a55e-c9b9e16a009f req-088bea66-f384-43d8-ba17-23a77a64c1ba service nova] Lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:20.054848 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b2684041-07f0-4245-a55e-c9b9e16a009f req-088bea66-f384-43d8-ba17-23a77a64c1ba service nova] Lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:20.054848 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b2684041-07f0-4245-a55e-c9b9e16a009f req-088bea66-f384-43d8-ba17-23a77a64c1ba service nova] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] No waiting events found dispatching network-vif-unplugged-82e239ac-e0e4-44e8-8a67-ddd602e91c7d {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:12:20.054848 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b2684041-07f0-4245-a55e-c9b9e16a009f req-088bea66-f384-43d8-ba17-23a77a64c1ba service nova] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Received event network-vif-unplugged-82e239ac-e0e4-44e8-8a67-ddd602e91c7d for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:12:20.093313 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Instance destroyed successfully. Jan 26 19:12:20.093678 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Lazy-loading 'resources' on Instance uuid 100d7d01-ce38-4e2e-ac3d-84ade2fd4605 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:12:20.597634 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:12:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerAddressesTestJSON-server-81255324',display_name='tempest-ServerAddressesTestJSON-server-81255324',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serveraddressestestjson-server-81255324',id=88,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:12:17Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='41b3e91a089648cf8ca8f046abf927a8',ramdisk_id='',reservation_id='r-mj39idp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerAddressesTestJSON-410922799',owner_user_name='tempest-ServerAddressesTestJSON-410922799-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:12:17Z,user_data=None,user_id='afcecc63273f4bfda195a472998c466e',uuid=100d7d01-ce38-4e2e-ac3d-84ade2fd4605,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82e239ac-e0e4-44e8-8a67-ddd602e91c7d", "address": "fa:16:3e:b0:d5:3c", "network": {"id": "3cc7944a-7869-42f0-9bdc-9f7a2df385eb", "bridge": "br-int", "label": "tempest-ServerAddressesTestJSON-1465657991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "41b3e91a089648cf8ca8f046abf927a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82e239ac-e0", "ovs_interfaceid": "82e239ac-e0e4-44e8-8a67-ddd602e91c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:12:20.597952 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Converting VIF {"id": "82e239ac-e0e4-44e8-8a67-ddd602e91c7d", "address": "fa:16:3e:b0:d5:3c", "network": {"id": "3cc7944a-7869-42f0-9bdc-9f7a2df385eb", "bridge": "br-int", "label": "tempest-ServerAddressesTestJSON-1465657991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "41b3e91a089648cf8ca8f046abf927a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82e239ac-e0", "ovs_interfaceid": "82e239ac-e0e4-44e8-8a67-ddd602e91c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:12:20.598727 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:d5:3c,bridge_name='br-int',has_traffic_filtering=True,id=82e239ac-e0e4-44e8-8a67-ddd602e91c7d,network=Network(3cc7944a-7869-42f0-9bdc-9f7a2df385eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82e239ac-e0') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:12:20.599113 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:d5:3c,bridge_name='br-int',has_traffic_filtering=True,id=82e239ac-e0e4-44e8-8a67-ddd602e91c7d,network=Network(3cc7944a-7869-42f0-9bdc-9f7a2df385eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82e239ac-e0') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:12:20.600539 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:20.600914 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82e239ac-e0, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:12:20.635092 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:20.636189 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:20.637841 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:12:20.639188 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:20.640156 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:20.640416 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=154b1ff7-59ac-4605-b61d-4bf41af9980a) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:12:20.642908 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:20.645484 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:d5:3c,bridge_name='br-int',has_traffic_filtering=True,id=82e239ac-e0e4-44e8-8a67-ddd602e91c7d,network=Network(3cc7944a-7869-42f0-9bdc-9f7a2df385eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82e239ac-e0') Jan 26 19:12:20.645907 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Deleting instance files /opt/stack/data/nova/instances/100d7d01-ce38-4e2e-ac3d-84ade2fd4605_del Jan 26 19:12:20.646496 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Deletion of /opt/stack/data/nova/instances/100d7d01-ce38-4e2e-ac3d-84ade2fd4605_del complete Jan 26 19:12:20.966533 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 295123b2-57e9-4b0d-af2d-70b35167f85e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:12:20.966906 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 100d7d01-ce38-4e2e-ac3d-84ade2fd4605 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:12:20.966906 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 2 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:12:20.967044 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=896MB phys_disk=399GB used_disk=2GB total_vcpus=8 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:12:19 up 40 min, 13 users, load average: 4.43, 5.10, 4.22\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '1', 'num_os_type_None': '2', 'num_proj_e10cba04043c48658cbbee662762e008': '1', 'io_workload': '0', 'num_task_deleting': '1', 'num_proj_41b3e91a089648cf8ca8f046abf927a8': '1'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:12:21.065059 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:12:21.153969 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Took 1.33 seconds to destroy the instance on the hypervisor. Jan 26 19:12:21.154351 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:12:21.154575 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:12:21.154707 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:12:21.155075 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:12:21.234985 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:12:21.568409 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:12:21.667946 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-444959fb-4703-454e-8606-f7a6bebfcce7 req-77bab6f0-b8f3-449f-8a13-bd01888f9a46 service nova] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Received event network-vif-deleted-82e239ac-e0e4-44e8-8a67-ddd602e91c7d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:12:21.668192 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-444959fb-4703-454e-8606-f7a6bebfcce7 req-77bab6f0-b8f3-449f-8a13-bd01888f9a46 service nova] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Neutron deleted interface 82e239ac-e0e4-44e8-8a67-ddd602e91c7d; detaching it from the instance and deleting it from the info cache Jan 26 19:12:21.668388 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-444959fb-4703-454e-8606-f7a6bebfcce7 req-77bab6f0-b8f3-449f-8a13-bd01888f9a46 service nova] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:12:22.027691 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:12:22.074265 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:12:22.074654 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.167s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:22.090426 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d827c4dc-6595-4c78-8346-d28422e4539d req-45b32977-075c-4629-a84a-8a539e6f14ba service nova] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Received event network-vif-unplugged-82e239ac-e0e4-44e8-8a67-ddd602e91c7d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:12:22.090590 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d827c4dc-6595-4c78-8346-d28422e4539d req-45b32977-075c-4629-a84a-8a539e6f14ba service nova] Acquiring lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:22.091806 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d827c4dc-6595-4c78-8346-d28422e4539d req-45b32977-075c-4629-a84a-8a539e6f14ba service nova] Lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:22.091806 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d827c4dc-6595-4c78-8346-d28422e4539d req-45b32977-075c-4629-a84a-8a539e6f14ba service nova] Lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:22.091806 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d827c4dc-6595-4c78-8346-d28422e4539d req-45b32977-075c-4629-a84a-8a539e6f14ba service nova] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] No waiting events found dispatching network-vif-unplugged-82e239ac-e0e4-44e8-8a67-ddd602e91c7d {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:12:22.091806 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d827c4dc-6595-4c78-8346-d28422e4539d req-45b32977-075c-4629-a84a-8a539e6f14ba service nova] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Received event network-vif-unplugged-82e239ac-e0e4-44e8-8a67-ddd602e91c7d for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:12:22.176628 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-444959fb-4703-454e-8606-f7a6bebfcce7 req-77bab6f0-b8f3-449f-8a13-bd01888f9a46 service nova] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Detach interface failed, port_id=82e239ac-e0e4-44e8-8a67-ddd602e91c7d, reason: Instance 100d7d01-ce38-4e2e-ac3d-84ade2fd4605 could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:12:22.532274 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Took 1.38 seconds to deallocate network for instance. Jan 26 19:12:22.793847 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:23.042100 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:23.042429 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:23.074958 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:12:23.075295 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:12:23.075613 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:12:23.187279 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:12:23.692682 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:12:24.205148 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.162s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:24.259711 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Deleted allocations for instance 100d7d01-ce38-4e2e-ac3d-84ade2fd4605 Jan 26 19:12:24.895429 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:12:25.269293 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bc2b8fd7-5c11-491f-9ad2-c860aade27c2 tempest-ServerAddressesTestJSON-410922799 tempest-ServerAddressesTestJSON-410922799-project-member] Lock "100d7d01-ce38-4e2e-ac3d-84ade2fd4605" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 5.949s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:25.643217 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:26.896270 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:12:26.896270 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:12:26.896270 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:12:27.795758 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:27.836785 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:27.891690 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:12:29.638138 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:12:29.638138 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] VM Stopped (Lifecycle Event) Jan 26 19:12:30.141303 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-4e45b9ba-a52c-4eb8-b3e4-628ddfc784c4 None None] [instance: d7a8111c-3e4d-4f55-80db-4c3bd80ecb0f] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:12:30.644709 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:31.238909 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:32.796116 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:33.962072 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:35.089141 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:12:35.089745 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] VM Stopped (Lifecycle Event) Jan 26 19:12:35.593193 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-dcf99b7b-c30b-4003-83b1-126ad89679d8 None None] [instance: 100d7d01-ce38-4e2e-ac3d-84ade2fd4605] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:12:35.646824 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:35.684334 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Acquiring lock "295123b2-57e9-4b0d-af2d-70b35167f85e" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:35.684525 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:35.704707 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "d262fe4c-575d-4eb7-a180-467686ddeec9" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:35.704929 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:36.187905 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lazy-loading 'flavor' on Instance uuid 295123b2-57e9-4b0d-af2d-70b35167f85e {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:12:36.207965 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:12:36.750978 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:36.750978 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:36.755790 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:12:36.755790 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Claim successful on node np0005596550.novalocal Jan 26 19:12:37.196839 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.512s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:37.839398 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:37.909579 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:12:38.307125 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Acquiring lock "295123b2-57e9-4b0d-af2d-70b35167f85e" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:38.307475 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:38.307510 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Attaching volume 9269157b-43f4-432c-b270-58069bb4a632 to /dev/vdb Jan 26 19:12:38.344043 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': True, 'host': 'np0005596550.novalocal', 'execute': None}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:12:38.345318 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:38.352664 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:38.354004 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f430784-c794-4a28-8c3b-db4f22e8e4e7]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:38.356690 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[0609248e-dff3-49a1-9229-40c40d3d6d43]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:12:38.356690 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:12:38.356690 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:12:38.356690 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:12:38.356690 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:38.356690 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:12:38.356690 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:12:38.356690 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:38.356690 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:12:38.356690 np0005596550.novalocal nova-compute[189076]: with open_scini_device() as fd: Jan 26 19:12:38.356690 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:38.356690 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:12:38.356690 np0005596550.novalocal nova-compute[189076]: return next(self.gen) Jan 26 19:12:38.356690 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^ Jan 26 19:12:38.356690 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:12:38.356690 np0005596550.novalocal nova-compute[189076]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:12:38.356690 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:38.356690 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:12:38.356975 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[0609248e-dff3-49a1-9229-40c40d3d6d43]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:38.357212 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.scaleio [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:12:38.357404 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.scaleio [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:12:38.358293 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:38.370693 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:38.370915 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[7679b141-2749-4f4b-996a-a9fea5982389]: (4, ('/dev/vda2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:38.372047 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:38.381576 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:38.382012 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e6a4a3-d89b-46a6-b2e1-b0bf4caa6039]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:38.383465 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0567dd-50a9-4ba1-af57-e83a8be24a03]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:38.383750 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Running cmd (subprocess): nvme version {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:38.399671 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] 'nvme version' failed. Not Retrying. {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:12:38.400044 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] nvme not present on system {{(pid=189076) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:12:38.401414 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=189076) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:12:38.402024 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.lightos [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fe64:d95d', 'fe80::50b2:68ff:fe0c:fabf'] Jan 26 19:12:38.402187 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:12:38.402343 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:12:38.403922 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] <== get_connector_properties: return (57ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': True, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fe64:d95d', 'fe80::50b2:68ff:fe0c:fabf']} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:12:38.403922 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.block_device [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Updating existing volume attachment record: 738017e6-39f8-418b-a110-56afd234d463 {{(pid=189076) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jan 26 19:12:38.413697 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:12:38.923209 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.172s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:38.923803 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:12:39.434450 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:12:39.434792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:12:39.435013 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:12:39.435256 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:12:39.682756 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd38980e1b13a4e598718de5500d63c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f9f30bee4144fcb8816ddc9af5c936', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:12:39.938688 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:12:40.175600 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Successfully created port: fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:12:40.447822 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:12:40.647951 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:40.747255 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d32f0e7c-7517-4980-8c49-6b4eb166a93a req-6fa0b1e7-13f9-48fb-bebc-6ffd784a9294 service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Received event network-vif-unplugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:12:40.747693 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d32f0e7c-7517-4980-8c49-6b4eb166a93a req-6fa0b1e7-13f9-48fb-bebc-6ffd784a9294 service nova] Acquiring lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:40.747693 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d32f0e7c-7517-4980-8c49-6b4eb166a93a req-6fa0b1e7-13f9-48fb-bebc-6ffd784a9294 service nova] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:40.747866 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d32f0e7c-7517-4980-8c49-6b4eb166a93a req-6fa0b1e7-13f9-48fb-bebc-6ffd784a9294 service nova] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:40.748041 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d32f0e7c-7517-4980-8c49-6b4eb166a93a req-6fa0b1e7-13f9-48fb-bebc-6ffd784a9294 service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] No waiting events found dispatching network-vif-unplugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:12:40.748212 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-d32f0e7c-7517-4980-8c49-6b4eb166a93a req-6fa0b1e7-13f9-48fb-bebc-6ffd784a9294 service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Received unexpected event network-vif-unplugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a for instance with vm_state building and task_state block_device_mapping. Jan 26 19:12:40.997825 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:41.206820 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Successfully updated port: fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:12:41.457263 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:12:41.459185 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:12:41.459740 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Creating image(s) Jan 26 19:12:41.460887 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "/opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:41.461317 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "/opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:41.462417 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "/opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:41.463744 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:12:41.470091 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:12:41.472284 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:41.556244 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.083s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:41.557197 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:41.557401 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:41.558041 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:12:41.562008 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:12:41.562487 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:41.636537 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.074s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:41.636995 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:41.685297 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk 1073741824" returned: 0 in 0.048s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:41.685843 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.128s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:41.686330 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:41.710349 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "refresh_cache-d262fe4c-575d-4eb7-a180-467686ddeec9" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:12:41.710447 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquired lock "refresh_cache-d262fe4c-575d-4eb7-a180-467686ddeec9" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:12:41.710650 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:12:41.779855 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.093s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:41.780138 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:12:41.780414 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:41.851448 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk --force-share --output=json" returned: 0 in 0.071s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:41.851812 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Cannot resize image /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:12:41.852213 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:12:41.852441 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Ensure instance console log exists: /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:12:41.852820 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:41.853098 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:41.853295 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:42.283266 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:12:42.435940 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:12:42.502267 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Calling os-brick to attach iSCSI Volume {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jan 26 19:12:42.502267 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632', 'target_lun': 0, 'volume_id': '9269157b-43f4-432c-b270-58069bb4a632', 'auth_method': 'CHAP', 'auth_username': 'M228SQBQMrBQ2Z4bBDFF', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:12:42.502267 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:12:42.502267 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:12:42.502267 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632', 'target_lun': 0, 'volume_id': '9269157b-43f4-432c-b270-58069bb4a632', 'auth_method': 'CHAP', 'auth_username': 'M228SQBQMrBQ2Z4bBDFF', 'auth_password': 'Fu2Mfv77RyQhYzZZ', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True} {{(pid=189076) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:12:42.503310 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:42.529895 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:12:42.530092 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[63c2b7aa-8d33-4952-88e1-1d36f02aa1cf]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:12:42.530092 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:12:42.530092 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:12:42.530092 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:12:42.530092 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:42.530092 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:12:42.530092 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:12:42.530092 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:42.530092 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:12:42.530092 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:12:42.530092 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:42.530092 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:12:42.530092 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:12:42.530092 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:42.530092 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:12:42.530092 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:12:42.530092 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:42.530092 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:12:42.530092 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:12:42.530092 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:12:42.530092 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:12:42.530092 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:12:42.530840 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c2b7aa-8d33-4952-88e1-1d36f02aa1cf]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:42.531276 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:12:42.531866 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:12:42.532101 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:12:42.537665 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:42.553324 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260" returned: 21 in 0.020s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:42.553817 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[64638a2d-a11e-4bad-af13-0d055e3826bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:42.554122 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:12:42.554122 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:42.555359 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260 --interface default --op new {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:42.565843 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:42.566092 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9c4d6e-3650-4217-917e-7f1a732fd769]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:42.566340 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632] added Jan 26 19:12:42.566340 np0005596550.novalocal nova-compute[189076]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:12:42.566340 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:12:42.566340 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:12:42.566340 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:42.566544 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=189076) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:12:42.566880 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.035(s), this was the 1st time calling it. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:12:42.566950 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:12:42.586576 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Updating instance_info_cache with network_info: [{"id": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "address": "fa:16:3e:51:29:69", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6d4cd-90", "ovs_interfaceid": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:12:42.802698 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a11ea850-ca1c-48a9-8079-9bf15a6ee34c req-f6ef0ecb-8f5b-4657-819e-2a53a6f67798 service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Received event network-changed-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:12:42.802898 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a11ea850-ca1c-48a9-8079-9bf15a6ee34c req-f6ef0ecb-8f5b-4657-819e-2a53a6f67798 service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Refreshing instance network info cache due to event network-changed-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:12:42.806835 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a11ea850-ca1c-48a9-8079-9bf15a6ee34c req-f6ef0ecb-8f5b-4657-819e-2a53a6f67798 service nova] Acquiring lock "refresh_cache-d262fe4c-575d-4eb7-a180-467686ddeec9" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:12:42.840408 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:43.089561 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Releasing lock "refresh_cache-d262fe4c-575d-4eb7-a180-467686ddeec9" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:12:43.089955 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Instance network_info: |[{"id": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "address": "fa:16:3e:51:29:69", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6d4cd-90", "ovs_interfaceid": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:12:43.090258 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a11ea850-ca1c-48a9-8079-9bf15a6ee34c req-f6ef0ecb-8f5b-4657-819e-2a53a6f67798 service nova] Acquired lock "refresh_cache-d262fe4c-575d-4eb7-a180-467686ddeec9" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:12:43.090477 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-a11ea850-ca1c-48a9-8079-9bf15a6ee34c req-f6ef0ecb-8f5b-4657-819e-2a53a6f67798 service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Refreshing network info cache for port fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:12:43.094055 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Start _get_guest_xml network_info=[{"id": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "address": "fa:16:3e:51:29:69", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6d4cd-90", "ovs_interfaceid": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:12:43.105968 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:12:43.107929 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueTestJSON-server-2031478745', uuid='d262fe4c-575d-4eb7-a180-467686ddeec9'), owner=OwnerMeta(userid='d38980e1b13a4e598718de5500d63c87', username='tempest-ServerRescueTestJSON-1540688849-project-member', projectid='d5f9f30bee4144fcb8816ddc9af5c936', projectname='tempest-ServerRescueTestJSON-1540688849'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "address": "fa:16:3e:51:29:69", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6d4cd-90", "ovs_interfaceid": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472763.1073275) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:12:43.110009 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:12:43.110519 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:12:43.112730 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:12:43.113219 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:12:43.114417 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:12:43.114967 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:12:43.115198 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:12:43.115362 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:12:43.115562 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:12:43.115748 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:12:43.115906 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:12:43.116148 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:12:43.116327 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:12:43.116520 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:12:43.116700 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:12:43.116913 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:12:43.120263 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:12:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueTestJSON-server-2031478745',display_name='tempest-ServerRescueTestJSON-server-2031478745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverrescuetestjson-server-2031478745',id=89,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5f9f30bee4144fcb8816ddc9af5c936',ramdisk_id='',reservation_id='r-thd4ri3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueTestJSON-1540688849',owner_user_name='tempest-ServerRescueTestJSON-1540688849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:12:40Z,user_data=None,user_id='d38980e1b13a4e598718de5500d63c87',uuid=d262fe4c-575d-4eb7-a180-467686ddeec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "address": "fa:16:3e:51:29:69", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6d4cd-90", "ovs_interfaceid": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:12:43.120442 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Converting VIF {"id": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "address": "fa:16:3e:51:29:69", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6d4cd-90", "ovs_interfaceid": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:12:43.121048 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:29:69,bridge_name='br-int',has_traffic_filtering=True,id=fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a,network=Network(50d5f066-62ba-4607-97e7-f02ccc9e9e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd6d4cd-90') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:12:43.121795 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lazy-loading 'pci_devices' on Instance uuid d262fe4c-575d-4eb7-a180-467686ddeec9 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:12:43.568953 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:12:43.570385 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:43.579760 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:43.579953 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3dc0b1-7aa1-419e-8255-8513dabb291e]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.name = iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.tpgt = -1 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.startup = automatic Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.leading_login = No Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.iscsi_ifacename = default Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.net_ifacename = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.ipaddress = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.prefix_len = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.hwaddress = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.transport_name = tcp Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.initiatorname = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.state = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.vlan_id = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.vlan_priority = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.vlan_state = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.iface_num = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.mtu = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.port = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.bootproto = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.subnet_mask = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.gateway = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id_state = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.dhcp_dns = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.dhcp_learn_iqn = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.dhcp_req_vendor_id_state = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id_state = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.dhcp_slp_da = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.fragmentation = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.gratuitous_arp = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.incoming_forwarding = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.tos_state = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.tos = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.ttl = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.delayed_ack = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.tcp_nagle = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf_state = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.tcp_timer_scale = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.tcp_timestamp = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.redirect = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.def_task_mgmt_timeout = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.header_digest = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.data_digest = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.immediate_data = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.initial_r2t = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.data_seq_inorder = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.data_pdu_inorder = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.erl = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.max_receive_data_len = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.first_burst_len = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.max_outstanding_r2t = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.max_burst_len = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.chap_auth = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.bidi_chap = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.strict_login_compliance = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.discovery_auth = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: iface.discovery_logout = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.discovery_address = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.discovery_port = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.discovery_type = fw Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.initial_cmdsn = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.initial_login_retry_max = 8 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.xmit_thread_priority = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.cmds_max = 128 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.queue_depth = 32 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.nr_sessions = 1 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.auth.authmethod = None Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.auth.username = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.auth.password = *** Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.auth.username_in = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.auth.password_in = Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.timeo.replacement_timeout = 120 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FastAbort = Yes Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.InitialR2T = No Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ImmediateData = Yes Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxConnections = 1 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ERL = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.scan = auto Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.reopen_max = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.session.conn_reopen_log_freq = 1 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.conn[0].address = 38.102.83.18 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.conn[0].port = 3260 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.conn[0].startup = manual Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.window_size = 524288 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.DataDigest = None Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.IFMarker = No Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.OFMarker = No Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: # END RECORD Jan 26 19:12:43.580883 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:43.582360 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:43.594274 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-a11ea850-ca1c-48a9-8079-9bf15a6ee34c req-f6ef0ecb-8f5b-4657-819e-2a53a6f67798 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:12:43.596557 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.014s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:43.596682 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f2da00-7aff-4e92-ad54-12dd42d8dc95]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:43.609917 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:43.611310 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] End _get_guest_xml xml= Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: d262fe4c-575d-4eb7-a180-467686ddeec9 Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: instance-00000059 Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: tempest-ServerRescueTestJSON-server-2031478745 Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:12:43 Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: tempest-ServerRescueTestJSON-1540688849-project-member Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: tempest-ServerRescueTestJSON-1540688849 Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: d262fe4c-575d-4eb7-a180-467686ddeec9 Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: d262fe4c-575d-4eb7-a180-467686ddeec9 Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:43.627238 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:12:43.628708 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Preparing to wait for external event network-vif-plugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:12:43.628708 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:43.628708 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:43.628885 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:43.630590 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:12:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueTestJSON-server-2031478745',display_name='tempest-ServerRescueTestJSON-server-2031478745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverrescuetestjson-server-2031478745',id=89,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5f9f30bee4144fcb8816ddc9af5c936',ramdisk_id='',reservation_id='r-thd4ri3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueTestJSON-1540688849',owner_user_name='tempest-ServerRescueTestJSON-1540688849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:12:40Z,user_data=None,user_id='d38980e1b13a4e598718de5500d63c87',uuid=d262fe4c-575d-4eb7-a180-467686ddeec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "address": "fa:16:3e:51:29:69", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6d4cd-90", "ovs_interfaceid": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:12:43.631396 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Converting VIF {"id": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "address": "fa:16:3e:51:29:69", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6d4cd-90", "ovs_interfaceid": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:12:43.632706 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:29:69,bridge_name='br-int',has_traffic_filtering=True,id=fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a,network=Network(50d5f066-62ba-4607-97e7-f02ccc9e9e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd6d4cd-90') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:12:43.633470 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:29:69,bridge_name='br-int',has_traffic_filtering=True,id=fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a,network=Network(50d5f066-62ba-4607-97e7-f02ccc9e9e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd6d4cd-90') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:12:43.634423 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.014s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:43.634616 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[764230fb-9845-4375-b318-4b8fa83bb62a]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:43.635079 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:43.635459 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:43.635864 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:12:43.636262 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:12:43.637168 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v M228SQBQMrBQ2Z4bBDFF {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:43.637400 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:43.637560 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8abcb216-2c25-558b-8722-b07fd143d579', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:12:43.639476 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:43.641624 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:12:43.645411 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:43.663325 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v M228SQBQMrBQ2Z4bBDFF" returned: 0 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:43.663481 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[7396d712-1183-4b65-8ac7-d1f68e91a25f]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:43.663967 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'M228SQBQMrBQ2Z4bBDFF'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:43.666238 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:43.666520 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:43.667985 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfdd6d4cd-90, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:12:43.669143 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfdd6d4cd-90, col_values=(('qos', UUID('ea6c9815-abae-4eb3-9713-df234f99b4fe')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:12:43.669410 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfdd6d4cd-90, col_values=(('external_ids', {'iface-id': 'fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:29:69', 'vm-uuid': 'd262fe4c-575d-4eb7-a180-467686ddeec9'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:12:43.670594 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:43.673108 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:12:43.677141 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:43.677276 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[6866f6fb-b874-447a-b2ff-4d895961ab22]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:43.677852 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:43.680165 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:43.680876 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:43.682046 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:29:69,bridge_name='br-int',has_traffic_filtering=True,id=fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a,network=Network(50d5f066-62ba-4607-97e7-f02ccc9e9e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd6d4cd-90') Jan 26 19:12:43.690139 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:43.690435 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4011998f-0c36-48ee-af9e-d435c125c511]: (4, ('tcp: [17] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:43.691018 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 (non-flash) Jan 26 19:12:43.691018 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:12:43.691249 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsi session list stdout=tcp: [17] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 (non-flash) Jan 26 19:12:43.691249 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:12:43.692713 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260 --login {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:43.720552 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260 --login" returned: 0 in 0.018s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:43.720692 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a18293-e05d-48ed-94a8-931572a01a35]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:43.720992 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632, portal: 38.102.83.18,3260] successful. Jan 26 19:12:43.720992 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:43.722426 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:43.731310 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:43.731426 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[8836cf55-b7df-45aa-8733-03ec915b97ca]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:43.731737 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:43.733280 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:43.750231 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:43.750407 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b59b4a-28a7-45ba-ac96-72c45b32a2c9]: (4, ('tcp: [17] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 (non-flash)\ntcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:43.750750 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 (non-flash) Jan 26 19:12:43.750750 np0005596550.novalocal nova-compute[189076]: tcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash) Jan 26 19:12:43.750750 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:12:43.750945 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsi session list stdout=tcp: [17] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 (non-flash) Jan 26 19:12:43.750945 np0005596550.novalocal nova-compute[189076]: tcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash) Jan 26 19:12:43.750945 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:12:43.751276 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.219s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:12:43.751483 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Connected to 38.102.83.18:3260 {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:12:43.751968 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] HCTL ('3', '-', '-', 0) found on session 18 with lun 0 {{(pid=189076) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:12:43.752104 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Scanning host 3 c: -, t: -, l: 0) {{(pid=189076) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:12:43.753435 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host3/scan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:43.774349 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host3/scan" returned: 0 in 0.019s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:43.774456 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0c7774-f70d-4fc5-b0e1-9596fb1db973]: (4, ('- - 0', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:43.774953 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Searching for a device in session 18 and hctl ['3', '*', '*', 0] yield: sdb {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:12:43.775377 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Connected to sdb using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632', 'target_lun': 0, 'volume_id': '9269157b-43f4-432c-b270-58069bb4a632', 'auth_method': 'CHAP', 'auth_username': 'M228SQBQMrBQ2Z4bBDFF', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True} {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:12:43.803581 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-a11ea850-ca1c-48a9-8079-9bf15a6ee34c req-f6ef0ecb-8f5b-4657-819e-2a53a6f67798 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:12:43.889050 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-a11ea850-ca1c-48a9-8079-9bf15a6ee34c req-f6ef0ecb-8f5b-4657-819e-2a53a6f67798 service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Updated VIF entry in instance network info cache for port fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:12:43.889366 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-a11ea850-ca1c-48a9-8079-9bf15a6ee34c req-f6ef0ecb-8f5b-4657-819e-2a53a6f67798 service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Updating instance_info_cache with network_info: [{"id": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "address": "fa:16:3e:51:29:69", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6d4cd-90", "ovs_interfaceid": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:12:44.392423 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a11ea850-ca1c-48a9-8079-9bf15a6ee34c req-f6ef0ecb-8f5b-4657-819e-2a53a6f67798 service nova] Releasing lock "refresh_cache-d262fe4c-575d-4eb7-a180-467686ddeec9" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:12:44.777324 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.275s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:12:44.778223 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] <== connect_volume: return (2275ms) {'type': 'block', 'scsi_wwn': '360014051c7626a2259c42948ce5da94c', 'path': '/dev/sdb'} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:12:44.778223 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '360014051c7626a2259c42948ce5da94c', 'path': '/dev/sdb'} {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jan 26 19:12:44.781211 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lazy-loading 'flavor' on Instance uuid 295123b2-57e9-4b0d-af2d-70b35167f85e {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:12:45.205678 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:12:45.205678 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:12:45.205678 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] No VIF found with MAC fa:16:3e:51:29:69, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:12:45.205678 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Using config drive Jan 26 19:12:45.286404 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] attach device xml: Jan 26 19:12:45.286404 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:45.286404 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:45.286404 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:45.286404 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:45.286404 np0005596550.novalocal nova-compute[189076]: 9269157b-43f4-432c-b270-58069bb4a632 Jan 26 19:12:45.286404 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:45.286404 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:330}} Jan 26 19:12:45.711386 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:12:45.809797 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Creating config drive at /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk.config Jan 26 19:12:45.812829 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpe0gw7ljm {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:45.934584 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpe0gw7ljm" returned: 0 in 0.120s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:46.040940 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:46.048118 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:46.051164 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:46.054528 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:46.058178 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:46.224115 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-926bd9fe-3224-4634-96f2-b7e08e42fd44 req-efd24b54-4aaf-4222-acba-4ab270036e2f service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Received event network-vif-plugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:12:46.224312 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-926bd9fe-3224-4634-96f2-b7e08e42fd44 req-efd24b54-4aaf-4222-acba-4ab270036e2f service nova] Acquiring lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:46.224493 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-926bd9fe-3224-4634-96f2-b7e08e42fd44 req-efd24b54-4aaf-4222-acba-4ab270036e2f service nova] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:46.224637 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-926bd9fe-3224-4634-96f2-b7e08e42fd44 req-efd24b54-4aaf-4222-acba-4ab270036e2f service nova] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:46.224796 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-926bd9fe-3224-4634-96f2-b7e08e42fd44 req-efd24b54-4aaf-4222-acba-4ab270036e2f service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Processing event network-vif-plugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:12:46.247741 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:12:46.249403 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:12:46.249403 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] VM Started (Lifecycle Event) Jan 26 19:12:46.253519 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:12:46.266465 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Instance spawned successfully. Jan 26 19:12:46.266733 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:12:46.309675 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:46.314787 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:46.321933 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:46.754210 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:12:46.757566 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:12:46.782991 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:12:46.783455 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:12:46.783753 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:12:46.784279 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:12:46.784630 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:12:46.785039 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:12:46.885546 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:12:46.886195 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] No BDM found with device name vdb, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:12:46.886195 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:12:46.886195 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] No VIF found with MAC fa:16:3e:64:d9:5d, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:12:47.260722 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:12:47.261018 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:12:47.261210 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] VM Paused (Lifecycle Event) Jan 26 19:12:47.291089 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Took 5.83 seconds to spawn the instance on the hypervisor. Jan 26 19:12:47.291322 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:12:47.769408 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:12:47.772554 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:12:47.772786 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] VM Resumed (Lifecycle Event) Jan 26 19:12:47.803362 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Took 11.09 seconds to build instance. Jan 26 19:12:47.861457 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:48.279811 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e578bf03-4837-44ed-bc52-3ceb26e2476d req-26350a16-318a-4809-9526-70251f57bb6f service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Received event network-vif-plugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:12:48.279811 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e578bf03-4837-44ed-bc52-3ceb26e2476d req-26350a16-318a-4809-9526-70251f57bb6f service nova] Acquiring lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:48.279811 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e578bf03-4837-44ed-bc52-3ceb26e2476d req-26350a16-318a-4809-9526-70251f57bb6f service nova] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:48.279811 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e578bf03-4837-44ed-bc52-3ceb26e2476d req-26350a16-318a-4809-9526-70251f57bb6f service nova] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:48.279811 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e578bf03-4837-44ed-bc52-3ceb26e2476d req-26350a16-318a-4809-9526-70251f57bb6f service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] No waiting events found dispatching network-vif-plugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:12:48.279811 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-e578bf03-4837-44ed-bc52-3ceb26e2476d req-26350a16-318a-4809-9526-70251f57bb6f service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Received unexpected event network-vif-plugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a for instance with vm_state active and task_state rescuing. Jan 26 19:12:48.282117 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:12:48.290806 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:12:48.296946 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Rescuing Jan 26 19:12:48.297670 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "refresh_cache-d262fe4c-575d-4eb7-a180-467686ddeec9" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:12:48.298241 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquired lock "refresh_cache-d262fe4c-575d-4eb7-a180-467686ddeec9" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:12:48.298913 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:12:48.305439 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-558bd26a-7c70-4d67-bef1-65690c410942 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 12.600s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:48.671287 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:48.701106 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ddfdea33-c437-46e1-9e04-0574296845fd tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 10.393s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:48.796242 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] During sync_power_state the instance has a pending task (rescuing). Skip. Jan 26 19:12:48.805378 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:12:49.071832 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:12:49.206698 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Updating instance_info_cache with network_info: [{"id": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "address": "fa:16:3e:51:29:69", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6d4cd-90", "ovs_interfaceid": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:12:49.709485 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Releasing lock "refresh_cache-d262fe4c-575d-4eb7-a180-467686ddeec9" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:12:49.857993 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Acquiring lock "295123b2-57e9-4b0d-af2d-70b35167f85e" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:49.858221 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:50.364875 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lazy-loading 'flavor' on Instance uuid 295123b2-57e9-4b0d-af2d-70b35167f85e {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:12:51.380129 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:51.381851 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:51.386958 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.528s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:51.402756 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:51.415084 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:51.517933 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4d0d6b88-b9cc-40ed-8371-8df2d1ecb52e req-4952c978-c61f-4d90-b4ee-4eec1b509cf3 service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Received event network-vif-unplugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:12:51.517933 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4d0d6b88-b9cc-40ed-8371-8df2d1ecb52e req-4952c978-c61f-4d90-b4ee-4eec1b509cf3 service nova] Acquiring lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:51.517933 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4d0d6b88-b9cc-40ed-8371-8df2d1ecb52e req-4952c978-c61f-4d90-b4ee-4eec1b509cf3 service nova] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:51.517933 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4d0d6b88-b9cc-40ed-8371-8df2d1ecb52e req-4952c978-c61f-4d90-b4ee-4eec1b509cf3 service nova] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:51.518198 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4d0d6b88-b9cc-40ed-8371-8df2d1ecb52e req-4952c978-c61f-4d90-b4ee-4eec1b509cf3 service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] No waiting events found dispatching network-vif-unplugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:12:51.518442 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-4d0d6b88-b9cc-40ed-8371-8df2d1ecb52e req-4952c978-c61f-4d90-b4ee-4eec1b509cf3 service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Received unexpected event network-vif-unplugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a for instance with vm_state active and task_state rescuing. Jan 26 19:12:51.538146 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:51.543585 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:51.593050 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Instance destroyed successfully. Jan 26 19:12:51.593050 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lazy-loading 'numa_topology' on Instance uuid d262fe4c-575d-4eb7-a180-467686ddeec9 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:12:52.101164 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Attempting rescue Jan 26 19:12:52.101164 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=189076) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4599}} Jan 26 19:12:52.103631 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Instance directory exists: not creating {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5157}} Jan 26 19:12:52.103951 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Creating image(s) Jan 26 19:12:52.104947 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "/opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:52.105455 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "/opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:52.106533 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "/opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:52.106919 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lazy-loading 'trusted_certs' on Instance uuid d262fe4c-575d-4eb7-a180-467686ddeec9 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:12:52.611942 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:12:52.611942 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:12:52.614580 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:12:52.615634 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:52.616100 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:52.616453 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:12:52.619123 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:12:52.619504 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:52.681417 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.062s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:52.681943 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk.rescue {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:52.746279 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Acquiring lock "295123b2-57e9-4b0d-af2d-70b35167f85e" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:52.746279 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:52.746279 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Attaching volume 9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 to /dev/vdc Jan 26 19:12:52.760340 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk.rescue" returned: 0 in 0.078s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:52.760821 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.145s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:52.761271 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lazy-loading 'migration_context' on Instance uuid d262fe4c-575d-4eb7-a180-467686ddeec9 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:12:52.803650 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': True, 'host': 'np0005596550.novalocal', 'execute': None}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:12:52.804759 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:52.812380 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:52.812620 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[b273a7ae-e708-42d0-9999-166da016cce2]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:52.814425 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[0ef034e0-3986-49d3-87fb-39e87da274bb]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:12:52.814425 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:12:52.814425 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:12:52.814425 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:12:52.814425 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:52.814425 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:12:52.814425 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:12:52.814425 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:52.814425 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:12:52.814425 np0005596550.novalocal nova-compute[189076]: with open_scini_device() as fd: Jan 26 19:12:52.814425 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:52.814425 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:12:52.814425 np0005596550.novalocal nova-compute[189076]: return next(self.gen) Jan 26 19:12:52.814425 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^ Jan 26 19:12:52.814425 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:12:52.814425 np0005596550.novalocal nova-compute[189076]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:12:52.814425 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:52.814425 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:12:52.814904 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef034e0-3986-49d3-87fb-39e87da274bb]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:52.815358 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.scaleio [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:12:52.815582 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.scaleio [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:12:52.816307 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:52.824343 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:52.824599 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1df65d-ad0c-458d-9ae7-f782fcc58c3d]: (4, ('/dev/vda2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:52.825282 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:52.835445 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:52.835929 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[156a6efb-a5f4-4de7-b706-e109adb4a305]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:52.837202 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[e600febd-6e5b-408d-a8f7-063ac63409f5]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:52.837724 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Running cmd (subprocess): nvme version {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:52.856034 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] 'nvme version' failed. Not Retrying. {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:12:52.856712 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] nvme not present on system {{(pid=189076) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:12:52.858862 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=189076) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:12:52.858862 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.lightos [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fe64:d95d', 'fe80::50b2:68ff:fe0c:fabf'] Jan 26 19:12:52.859083 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:12:52.859302 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:12:52.859711 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] <== get_connector_properties: return (55ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': True, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fe64:d95d', 'fe80::50b2:68ff:fe0c:fabf']} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:12:52.860324 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.block_device [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Updating existing volume attachment record: d5c29ae1-424e-4233-8447-1df08f1549ad {{(pid=189076) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jan 26 19:12:53.267879 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:12:53.269703 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:12:53.270231 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Start _get_guest_xml network_info=[{"id": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "address": "fa:16:3e:51:29:69", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueTestJSON-1607741291-network", "vif_mac": "fa:16:3e:51:29:69"}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6d4cd-90", "ovs_interfaceid": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue={'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:12:53.270413 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lazy-loading 'resources' on Instance uuid d262fe4c-575d-4eb7-a180-467686ddeec9 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:12:53.542387 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7ef77434-daac-49f6-97e3-438c681c6319 req-62122ab1-b4cc-406a-adbe-9d2eede239c4 service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Received event network-vif-unplugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:12:53.542951 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7ef77434-daac-49f6-97e3-438c681c6319 req-62122ab1-b4cc-406a-adbe-9d2eede239c4 service nova] Acquiring lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:53.543150 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7ef77434-daac-49f6-97e3-438c681c6319 req-62122ab1-b4cc-406a-adbe-9d2eede239c4 service nova] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:53.543366 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7ef77434-daac-49f6-97e3-438c681c6319 req-62122ab1-b4cc-406a-adbe-9d2eede239c4 service nova] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:53.544795 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7ef77434-daac-49f6-97e3-438c681c6319 req-62122ab1-b4cc-406a-adbe-9d2eede239c4 service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] No waiting events found dispatching network-vif-unplugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:12:53.544795 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-7ef77434-daac-49f6-97e3-438c681c6319 req-62122ab1-b4cc-406a-adbe-9d2eede239c4 service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Received unexpected event network-vif-unplugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a for instance with vm_state active and task_state rescuing. Jan 26 19:12:53.672718 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:53.773790 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:12:53.776940 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:12:53.778316 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueTestJSON-server-2031478745', uuid='d262fe4c-575d-4eb7-a180-467686ddeec9'), owner=OwnerMeta(userid='d38980e1b13a4e598718de5500d63c87', username='tempest-ServerRescueTestJSON-1540688849-project-member', projectid='d5f9f30bee4144fcb8816ddc9af5c936', projectname='tempest-ServerRescueTestJSON-1540688849'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "address": "fa:16:3e:51:29:69", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueTestJSON-1607741291-network", "vif_mac": "fa:16:3e:51:29:69"}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6d4cd-90", "ovs_interfaceid": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472773.7779098) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:12:53.779407 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:12:53.779788 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:12:53.780904 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:12:53.781269 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:12:53.782212 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:12:53.782654 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:12:53.782902 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:12:53.783004 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:12:53.783207 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:12:53.783365 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:12:53.783528 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:12:53.783750 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:12:53.784098 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:12:53.784277 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:12:53.784446 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:12:53.784640 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:12:53.784847 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lazy-loading 'vcpu_model' on Instance uuid d262fe4c-575d-4eb7-a180-467686ddeec9 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:12:54.287605 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:12:54.294893 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:12:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueTestJSON-server-2031478745',display_name='tempest-ServerRescueTestJSON-server-2031478745',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverrescuetestjson-server-2031478745',id=89,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:12:47Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='d5f9f30bee4144fcb8816ddc9af5c936',ramdisk_id='',reservation_id='r-thd4ri3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueTestJSON-1540688849',owner_user_name='tempest-ServerRescueTestJSON-1540688849-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:12:47Z,user_data=None,user_id='d38980e1b13a4e598718de5500d63c87',uuid=d262fe4c-575d-4eb7-a180-467686ddeec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "address": "fa:16:3e:51:29:69", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueTestJSON-1607741291-network", "vif_mac": "fa:16:3e:51:29:69"}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6d4cd-90", "ovs_interfaceid": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:12:54.295546 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Converting VIF {"id": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "address": "fa:16:3e:51:29:69", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueTestJSON-1607741291-network", "vif_mac": "fa:16:3e:51:29:69"}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6d4cd-90", "ovs_interfaceid": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:12:54.298788 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:29:69,bridge_name='br-int',has_traffic_filtering=True,id=fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a,network=Network(50d5f066-62ba-4607-97e7-f02ccc9e9e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd6d4cd-90') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:12:54.298788 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lazy-loading 'pci_devices' on Instance uuid d262fe4c-575d-4eb7-a180-467686ddeec9 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:12:54.802098 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] End _get_guest_xml xml= Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: d262fe4c-575d-4eb7-a180-467686ddeec9 Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: instance-00000059 Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: tempest-ServerRescueTestJSON-server-2031478745 Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:12:53 Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: ide Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: pc Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: tempest-ServerRescueTestJSON-1540688849-project-member Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: tempest-ServerRescueTestJSON-1540688849 Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: d262fe4c-575d-4eb7-a180-467686ddeec9 Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: d262fe4c-575d-4eb7-a180-467686ddeec9 Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: Jan 26 19:12:54.803931 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:12:54.808834 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Instance destroyed successfully. Jan 26 19:12:56.450024 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:12:56.450293 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] No BDM found with device name vdb, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:12:56.450629 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:12:56.451014 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] No VIF found with MAC fa:16:3e:51:29:69, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:12:56.452097 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Using config drive Jan 26 19:12:56.957033 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lazy-loading 'ec2_ids' on Instance uuid d262fe4c-575d-4eb7-a180-467686ddeec9 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:12:57.414016 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Calling os-brick to attach iSCSI Volume {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jan 26 19:12:57.414915 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6', 'target_lun': 0, 'volume_id': '9b5f535f-532a-41aa-84ad-d1d38c3cf3b6', 'auth_method': 'CHAP', 'auth_username': 'kk6eN4Vh8nEkR8wjYtCF', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:12:57.415156 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:12:57.461530 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:12:57.462132 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lazy-loading 'keypairs' on Instance uuid d262fe4c-575d-4eb7-a180-467686ddeec9 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:12:57.965029 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:12:57.967514 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:12:58.046128 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Creating config drive at /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk.config.rescue Jan 26 19:12:58.048520 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmppbisytbx {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:58.176242 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmppbisytbx" returned: 0 in 0.128s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:58.262188 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:58.269171 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:58.271232 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:58.280023 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:58.414901 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-be4258e3-0cbb-4a64-a420-e268e49db729 req-c6f9fba6-70c9-429a-8cef-f903206bb22d service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Received event network-vif-plugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:12:58.415095 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-be4258e3-0cbb-4a64-a420-e268e49db729 req-c6f9fba6-70c9-429a-8cef-f903206bb22d service nova] Acquiring lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:12:58.415276 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-be4258e3-0cbb-4a64-a420-e268e49db729 req-c6f9fba6-70c9-429a-8cef-f903206bb22d service nova] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:12:58.415413 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-be4258e3-0cbb-4a64-a420-e268e49db729 req-c6f9fba6-70c9-429a-8cef-f903206bb22d service nova] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:12:58.415554 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-be4258e3-0cbb-4a64-a420-e268e49db729 req-c6f9fba6-70c9-429a-8cef-f903206bb22d service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] No waiting events found dispatching network-vif-plugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:12:58.417031 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-be4258e3-0cbb-4a64-a420-e268e49db729 req-c6f9fba6-70c9-429a-8cef-f903206bb22d service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Received unexpected event network-vif-plugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a for instance with vm_state active and task_state rescuing. Jan 26 19:12:58.447529 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for d262fe4c-575d-4eb7-a180-467686ddeec9 due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:12:58.449333 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:12:58.449545 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] VM Resumed (Lifecycle Event) Jan 26 19:12:58.456585 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-04105a5f-a6f8-4e40-b1a5-0f79e456809d tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:12:58.517102 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:58.521467 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:58.527658 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:58.527658 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:58.673957 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:12:58.685402 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.270s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:12:58.685621 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6', 'target_lun': 0, 'volume_id': '9b5f535f-532a-41aa-84ad-d1d38c3cf3b6', 'auth_method': 'CHAP', 'auth_username': 'kk6eN4Vh8nEkR8wjYtCF', 'auth_password': 'iPGHHGoeA7UnG5Ns', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True} {{(pid=189076) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:12:58.687465 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[8484acd1-2f5e-4ab9-9c6f-16d2aa87c6e6]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[8484acd1-2f5e-4ab9-9c6f-16d2aa87c6e6]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:58.697791 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:12:58.698233 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:12:58.698266 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:12:58.699040 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:58.708818 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260" returned: 21 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:58.708995 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3fe167-c8e9-4467-ae3c-5fd3b47ffe2b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:58.709327 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:12:58.709327 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:58.710020 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260 --interface default --op new {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:58.718541 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:58.718684 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb52b1dc-36c7-4b84-844e-b3296501a738]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:58.719019 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6] added Jan 26 19:12:58.719019 np0005596550.novalocal nova-compute[189076]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:12:58.719019 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:12:58.719019 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:12:58.719019 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:58.719183 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=189076) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:12:58.719404 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.021(s), this was the 1st time calling it. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:12:58.719597 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:12:58.954570 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:12:58.958713 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:12:59.464793 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:12:59.465667 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] VM Started (Lifecycle Event) Jan 26 19:12:59.721144 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:12:59.725280 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:59.735782 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260" returned: 0 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:59.736814 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f14d228-2d1d-4b7b-b38b-b1ccebb3c58f]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.name = iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.tpgt = -1 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.startup = automatic Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.leading_login = No Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.iscsi_ifacename = default Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.net_ifacename = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.ipaddress = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.prefix_len = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.hwaddress = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.transport_name = tcp Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.initiatorname = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.state = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.vlan_id = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.vlan_priority = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.vlan_state = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.iface_num = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.mtu = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.port = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.bootproto = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.subnet_mask = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.gateway = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id_state = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.dhcp_dns = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.dhcp_learn_iqn = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.dhcp_req_vendor_id_state = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id_state = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.dhcp_slp_da = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.fragmentation = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.gratuitous_arp = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.incoming_forwarding = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.tos_state = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.tos = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.ttl = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.delayed_ack = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.tcp_nagle = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf_state = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.tcp_timer_scale = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.tcp_timestamp = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.redirect = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.def_task_mgmt_timeout = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.header_digest = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.data_digest = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.immediate_data = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.initial_r2t = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.data_seq_inorder = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.data_pdu_inorder = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.erl = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.max_receive_data_len = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.first_burst_len = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.max_outstanding_r2t = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.max_burst_len = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.chap_auth = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.bidi_chap = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.strict_login_compliance = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.discovery_auth = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: iface.discovery_logout = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.discovery_address = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.discovery_port = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.discovery_type = fw Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.initial_cmdsn = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.initial_login_retry_max = 8 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.xmit_thread_priority = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.cmds_max = 128 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.queue_depth = 32 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.nr_sessions = 1 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.auth.authmethod = None Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.auth.username = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.auth.password = *** Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.auth.username_in = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.auth.password_in = Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.timeo.replacement_timeout = 120 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FastAbort = Yes Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.InitialR2T = No Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ImmediateData = Yes Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxConnections = 1 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ERL = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.scan = auto Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.reopen_max = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.session.conn_reopen_log_freq = 1 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.conn[0].address = 38.102.83.18 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.conn[0].port = 3260 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.conn[0].startup = manual Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.window_size = 524288 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.DataDigest = None Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.IFMarker = No Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.OFMarker = No Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: # END RECORD Jan 26 19:12:59.737060 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:59.739899 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:59.746803 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:59.746985 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[68abd466-76ad-4fb1-8401-0433b6a61fd7]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:59.747329 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:59.749180 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:59.756796 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:59.756921 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[b996bd44-b649-4195-a81a-0000a72db265]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:59.757371 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:59.758059 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v kk6eN4Vh8nEkR8wjYtCF {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:59.767683 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v kk6eN4Vh8nEkR8wjYtCF" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:59.767862 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[9781ac15-1dda-4c65-9088-4c569f95a332]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:59.768275 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kk6eN4Vh8nEkR8wjYtCF'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:59.769622 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:59.780563 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:59.780670 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfef297b-7e67-447b-b7ce-652e2ff61531]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:59.781298 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:59.783591 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:59.790437 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:59.790587 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c236bd5-f0d2-4065-b77e-3fe0aa3d4bce]: (4, ('tcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash)\ntcp: [19] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:59.790952 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash) Jan 26 19:12:59.790952 np0005596550.novalocal nova-compute[189076]: tcp: [19] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e (non-flash) Jan 26 19:12:59.790952 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:12:59.791178 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsi session list stdout=tcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash) Jan 26 19:12:59.791178 np0005596550.novalocal nova-compute[189076]: tcp: [19] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e (non-flash) Jan 26 19:12:59.791178 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:12:59.792830 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260 --login {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:59.815652 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260 --login" returned: 0 in 0.022s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:59.815821 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa782e8-1b6c-47bd-97c4-d20d58fa2682]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:59.816198 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6, portal: 38.102.83.18,3260] successful. Jan 26 19:12:59.816198 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:59.816924 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:59.825612 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:59.825749 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1f15f3-ac77-49f0-9e39-4c5313842ba5]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:59.826222 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:59.828795 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:59.837536 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:59.837723 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6161c1b-6330-48ba-9135-3a7a308443bc]: (4, ('tcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash)\ntcp: [19] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e (non-flash)\ntcp: [20] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:59.838148 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash) Jan 26 19:12:59.838148 np0005596550.novalocal nova-compute[189076]: tcp: [19] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e (non-flash) Jan 26 19:12:59.838148 np0005596550.novalocal nova-compute[189076]: tcp: [20] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 (non-flash) Jan 26 19:12:59.838148 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:12:59.838319 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsi session list stdout=tcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash) Jan 26 19:12:59.838319 np0005596550.novalocal nova-compute[189076]: tcp: [19] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e (non-flash) Jan 26 19:12:59.838319 np0005596550.novalocal nova-compute[189076]: tcp: [20] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 (non-flash) Jan 26 19:12:59.838319 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:12:59.838691 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.141s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:12:59.838898 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Connected to 38.102.83.18:3260 {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:12:59.839597 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] HCTL ('4', '-', '-', 0) found on session 20 with lun 0 {{(pid=189076) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:12:59.839799 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Scanning host 4 c: -, t: -, l: 0) {{(pid=189076) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:12:59.840460 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host4/scan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:59.862447 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host4/scan" returned: 0 in 0.020s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:59.862595 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60fa1af-43f7-43d3-b461-89e5941c7cfe]: (4, ('- - 0', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:59.863645 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Searching for a device in session 20 and hctl ['4', '*', '*', 0] yield: None {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:12:59.972067 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:12:59.974664 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:13:00.185134 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "61de9322-0e97-42b2-990b-bd3d934cc215" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:00.185373 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "61de9322-0e97-42b2-990b-bd3d934cc215" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:00.448862 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4aec1c50-fe90-42a1-a676-01b5c13dade5 req-6d7f1fec-59e5-4fb5-a1fb-5947ab1aab88 service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Received event network-vif-plugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:13:00.449030 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4aec1c50-fe90-42a1-a676-01b5c13dade5 req-6d7f1fec-59e5-4fb5-a1fb-5947ab1aab88 service nova] Acquiring lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:00.449207 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4aec1c50-fe90-42a1-a676-01b5c13dade5 req-6d7f1fec-59e5-4fb5-a1fb-5947ab1aab88 service nova] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:00.449314 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4aec1c50-fe90-42a1-a676-01b5c13dade5 req-6d7f1fec-59e5-4fb5-a1fb-5947ab1aab88 service nova] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:00.449448 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4aec1c50-fe90-42a1-a676-01b5c13dade5 req-6d7f1fec-59e5-4fb5-a1fb-5947ab1aab88 service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] No waiting events found dispatching network-vif-plugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:13:00.449608 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-4aec1c50-fe90-42a1-a676-01b5c13dade5 req-6d7f1fec-59e5-4fb5-a1fb-5947ab1aab88 service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Received unexpected event network-vif-plugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a for instance with vm_state rescued and task_state None. Jan 26 19:13:00.688623 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:13:00.864608 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Searching for a device in session 20 and hctl ['4', '*', '*', 0] yield: sdc {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:13:00.865139 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Connected to sdc using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6', 'target_lun': 0, 'volume_id': '9b5f535f-532a-41aa-84ad-d1d38c3cf3b6', 'auth_method': 'CHAP', 'auth_username': 'kk6eN4Vh8nEkR8wjYtCF', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True} {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:13:00.865735 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.181s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:13:00.865952 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] <== connect_volume: return (3451ms) {'type': 'block', 'scsi_wwn': '36001405615ce0671fce4184a9cbf5828', 'path': '/dev/sdc'} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:13:00.866120 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '36001405615ce0671fce4184a9cbf5828', 'path': '/dev/sdc'} {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jan 26 19:13:00.868575 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lazy-loading 'flavor' on Instance uuid 295123b2-57e9-4b0d-af2d-70b35167f85e {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:13:01.225338 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:01.225613 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:01.231320 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:13:01.231478 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Claim successful on node np0005596550.novalocal Jan 26 19:13:01.375275 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] attach device xml: Jan 26 19:13:01.375275 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:01.375275 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:01.375275 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:01.375275 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:01.375275 np0005596550.novalocal nova-compute[189076]: 9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 Jan 26 19:13:01.375275 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:01.375275 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:330}} Jan 26 19:13:02.361133 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:13:02.862852 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:02.865739 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:13:02.951652 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:13:02.951834 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] No BDM found with device name vdb, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:13:02.951996 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] No BDM found with device name vdc, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:13:02.952149 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:13:02.952305 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] No VIF found with MAC fa:16:3e:64:d9:5d, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:13:03.839216 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:03.871461 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.646s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:03.871879 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:13:04.381349 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:13:04.381571 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:13:04.381939 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:13:04.382279 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:13:04.466659 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd38980e1b13a4e598718de5500d63c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f9f30bee4144fcb8816ddc9af5c936', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:13:04.905590 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:13:05.025095 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Successfully created port: e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:13:05.051885 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b293e66d-b521-4f96-9fe2-daa2b0a1dead tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 12.307s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:05.410051 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:13:05.533341 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Successfully updated port: e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:13:05.561427 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-701bdcac-5ed5-4402-bfba-eb14ad05568b req-105d3704-c99b-44db-b179-4d25e3ed0117 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received event network-changed-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:13:05.561427 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-701bdcac-5ed5-4402-bfba-eb14ad05568b req-105d3704-c99b-44db-b179-4d25e3ed0117 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Refreshing instance network info cache due to event network-changed-e3bacf6d-13be-48f5-8924-a141832f639b. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:13:05.561602 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-701bdcac-5ed5-4402-bfba-eb14ad05568b req-105d3704-c99b-44db-b179-4d25e3ed0117 service nova] Acquiring lock "refresh_cache-61de9322-0e97-42b2-990b-bd3d934cc215" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:13:05.561712 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-701bdcac-5ed5-4402-bfba-eb14ad05568b req-105d3704-c99b-44db-b179-4d25e3ed0117 service nova] Acquired lock "refresh_cache-61de9322-0e97-42b2-990b-bd3d934cc215" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:13:05.563290 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-701bdcac-5ed5-4402-bfba-eb14ad05568b req-105d3704-c99b-44db-b179-4d25e3ed0117 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Refreshing network info cache for port e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:13:05.990741 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Acquiring lock "295123b2-57e9-4b0d-af2d-70b35167f85e" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:05.991217 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:06.036446 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "refresh_cache-61de9322-0e97-42b2-990b-bd3d934cc215" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:13:06.066209 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-701bdcac-5ed5-4402-bfba-eb14ad05568b req-105d3704-c99b-44db-b179-4d25e3ed0117 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:13:06.151460 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-701bdcac-5ed5-4402-bfba-eb14ad05568b req-105d3704-c99b-44db-b179-4d25e3ed0117 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:13:06.325291 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-701bdcac-5ed5-4402-bfba-eb14ad05568b req-105d3704-c99b-44db-b179-4d25e3ed0117 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:13:06.422318 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:13:06.423187 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:13:06.423467 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Creating image(s) Jan 26 19:13:06.423878 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "/opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:06.424052 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "/opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:06.424568 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "/opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:06.425070 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:13:06.427793 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:13:06.428872 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:06.497915 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Detaching volume 9269157b-43f4-432c-b270-58069bb4a632 Jan 26 19:13:06.507360 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.078s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:06.507755 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:06.508205 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:06.508676 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:13:06.513324 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:13:06.513705 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:06.579591 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.block_device [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Attempting to driver detach volume 9269157b-43f4-432c-b270-58069bb4a632 from mountpoint /dev/vdb Jan 26 19:13:06.582751 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.069s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:06.583134 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:06.602089 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Found disk vdb by alias ua-9269157b-43f4-432c-b270-58069bb4a632 {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:13:06.604953 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Found disk vdb by alias ua-9269157b-43f4-432c-b270-58069bb4a632 {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:13:06.605232 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Attempting to detach device vdb from instance 295123b2-57e9-4b0d-af2d-70b35167f85e from the persistent domain config. {{(pid=189076) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2599}} Jan 26 19:13:06.605674 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] detach device xml: Jan 26 19:13:06.605674 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:06.605674 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:06.605674 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:06.605674 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:06.605674 np0005596550.novalocal nova-compute[189076]: 9269157b-43f4-432c-b270-58069bb4a632 Jan 26 19:13:06.605674 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:13:06.605674 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:06.605674 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:13:06.614845 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Found disk vdb by alias ua-9269157b-43f4-432c-b270-58069bb4a632 {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:13:06.615055 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Failed to detach device vdb from instance 295123b2-57e9-4b0d-af2d-70b35167f85e from the persistent domain config. Libvirt did not report any error but the device is still in the config. Jan 26 19:13:06.615267 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] (1/8): Attempting to detach device vdb with device alias ua-9269157b-43f4-432c-b270-58069bb4a632 from instance 295123b2-57e9-4b0d-af2d-70b35167f85e from the live domain config. {{(pid=189076) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2633}} Jan 26 19:13:06.615703 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] detach device xml: Jan 26 19:13:06.615703 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:06.615703 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:06.615703 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:06.615703 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:06.615703 np0005596550.novalocal nova-compute[189076]: 9269157b-43f4-432c-b270-58069bb4a632 Jan 26 19:13:06.615703 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:13:06.615703 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:06.615703 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:13:06.624185 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk 1073741824" returned: 0 in 0.041s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:06.624703 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.116s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:06.625205 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:06.713602 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.088s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:06.713976 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:13:06.714199 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:06.743707 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-9269157b-43f4-432c-b270-58069bb4a632 for instance 295123b2-57e9-4b0d-af2d-70b35167f85e {{(pid=189076) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2713}} Jan 26 19:13:06.744201 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Received event ua-9269157b-43f4-432c-b270-58069bb4a632> from libvirt while the driver is waiting for it; dispatched. {{(pid=189076) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2486}} Jan 26 19:13:06.749585 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Successfully detached device vdb from instance 295123b2-57e9-4b0d-af2d-70b35167f85e from the live domain config. Jan 26 19:13:06.752404 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] calling os-brick to detach iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jan 26 19:13:06.753467 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632', 'target_lun': 0, 'volume_id': '9269157b-43f4-432c-b270-58069bb4a632', 'auth_method': 'CHAP', 'auth_username': 'M228SQBQMrBQ2Z4bBDFF', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:13:06.753713 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:13:06.756434 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:13:06.757651 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:06.767077 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:06.769246 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac42c596-2f16-40b1-93cf-8de358fc57a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:06.769595 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:13:06.769595 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:13:06.769595 np0005596550.novalocal nova-compute[189076]: iSNS: Jan 26 19:13:06.769595 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:13:06.769595 np0005596550.novalocal nova-compute[189076]: STATIC: Jan 26 19:13:06.769595 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 Jan 26 19:13:06.769595 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:13:06.769595 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:13:06.769595 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 Jan 26 19:13:06.769595 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:13:06.769595 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:13:06.769595 np0005596550.novalocal nova-compute[189076]: FIRMWARE: Jan 26 19:13:06.769595 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:13:06.769595 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:13:06.769816 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:13:06.769816 np0005596550.novalocal nova-compute[189076]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:13:06.769816 np0005596550.novalocal nova-compute[189076]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=189076) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:13:06.770146 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632', 0)] {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:13:06.770855 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:06.778541 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:06.778663 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce15c99f-7874-47c6-9e35-790dd30c1bf6]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632\n38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:06.779577 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:06.791636 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:06.792206 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb21fac-8176-4f30-809c-9c150320e857]: (4, ('tcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash)\ntcp: [20] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:06.792789 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash) Jan 26 19:13:06.792789 np0005596550.novalocal nova-compute[189076]: tcp: [20] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 (non-flash) Jan 26 19:13:06.792789 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:13:06.792992 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsi session list stdout=tcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash) Jan 26 19:13:06.792992 np0005596550.novalocal nova-compute[189076]: tcp: [20] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 (non-flash) Jan 26 19:13:06.792992 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:13:06.793828 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Resulting device map defaultdict(. at 0x7fd76b6bba60>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632'): ({'sdb'}, set())}) {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:13:06.794148 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Removing single pathed devices sdb {{(pid=189076) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:13:06.795080 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:06.802803 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:13:06.803497 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[6b9c0fbb-bc8f-4df1-8344-cb744c9b7bab]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:13:06.803497 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:13:06.803497 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:13:06.803497 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:13:06.803497 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:06.803497 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:13:06.803497 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:13:06.803497 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:06.803497 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:13:06.803497 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:13:06.803497 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:06.803497 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:13:06.803497 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:13:06.803497 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:06.803497 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:13:06.803497 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:13:06.803497 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:06.803497 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:13:06.803497 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:13:06.803497 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:13:06.803497 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:13:06.803497 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:13:06.804341 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9c0fbb-bc8f-4df1-8344-cb744c9b7bab]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:06.805115 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Flushing IO for device /dev/sdb {{(pid=189076) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:13:06.806197 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:06.815790 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:06.815790 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ba045c-c846-4cde-9e29-35e831698f66]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:06.816454 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=189076) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:13:06.817265 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:06.817644 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:06.818066 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Cannot resize image /opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:13:06.818439 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:13:06.818676 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Ensure instance console log exists: /opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:13:06.819073 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:06.819358 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:06.819589 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:06.829236 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-701bdcac-5ed5-4402-bfba-eb14ad05568b req-105d3704-c99b-44db-b179-4d25e3ed0117 service nova] Releasing lock "refresh_cache-61de9322-0e97-42b2-990b-bd3d934cc215" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:13:06.829866 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquired lock "refresh_cache-61de9322-0e97-42b2-990b-bd3d934cc215" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:13:06.830139 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:13:06.865744 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:06.866012 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd517fd-e33f-479d-b90d-88ad8a8be49f]: (4, ('1', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:06.866359 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:13:06.866515 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] SCSI volumes sdb have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:13:06.866954 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632')] {{(pid=189076) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:13:06.867816 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:06.879856 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:06.879856 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[de52a759-16ed-4000-81e3-56c06cd9cef2]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:06.880013 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:06.880935 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260 --logout {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:06.908202 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260 --logout" returned: 0 in 0.027s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:06.908365 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db49024-c609-467f-96e9-03a127e0e1cc]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632, portal: 38.102.83.18,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:06.909060 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632, portal: 38.102.83.18,3260] Jan 26 19:13:06.909060 np0005596550.novalocal nova-compute[189076]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632, portal: 38.102.83.18,3260] successful. Jan 26 19:13:06.909060 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:06.911420 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260 --op delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:06.920398 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 -p 38.102.83.18:3260 --op delete" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:06.920544 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65fcb9f-6ea0-4ae3-aa3f-ee44e69b659f]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:06.921190 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:06.921459 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.165s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:13:06.921969 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] <== disconnect_volume: return (167ms) None {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:13:06.922210 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Disconnected iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jan 26 19:13:07.375143 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:13:07.502784 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:13:07.620184 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Updating instance_info_cache with network_info: [{"id": "e3bacf6d-13be-48f5-8924-a141832f639b", "address": "fa:16:3e:83:cd:a1", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bacf6d-13", "ovs_interfaceid": "e3bacf6d-13be-48f5-8924-a141832f639b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:13:07.901084 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:08.125155 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Releasing lock "refresh_cache-61de9322-0e97-42b2-990b-bd3d934cc215" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:13:08.127675 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Instance network_info: |[{"id": "e3bacf6d-13be-48f5-8924-a141832f639b", "address": "fa:16:3e:83:cd:a1", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bacf6d-13", "ovs_interfaceid": "e3bacf6d-13be-48f5-8924-a141832f639b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:13:08.127675 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Start _get_guest_xml network_info=[{"id": "e3bacf6d-13be-48f5-8924-a141832f639b", "address": "fa:16:3e:83:cd:a1", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bacf6d-13", "ovs_interfaceid": "e3bacf6d-13be-48f5-8924-a141832f639b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:13:08.132477 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:13:08.134233 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueTestJSON-server-1988772364', uuid='61de9322-0e97-42b2-990b-bd3d934cc215'), owner=OwnerMeta(userid='d38980e1b13a4e598718de5500d63c87', username='tempest-ServerRescueTestJSON-1540688849-project-member', projectid='d5f9f30bee4144fcb8816ddc9af5c936', projectname='tempest-ServerRescueTestJSON-1540688849'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e3bacf6d-13be-48f5-8924-a141832f639b", "address": "fa:16:3e:83:cd:a1", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bacf6d-13", "ovs_interfaceid": "e3bacf6d-13be-48f5-8924-a141832f639b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472788.1337035) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:13:08.135619 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:13:08.136135 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:13:08.137618 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:13:08.138117 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:13:08.139473 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:13:08.139976 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:13:08.140219 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:13:08.140400 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:13:08.140800 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:13:08.140990 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:13:08.141168 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:13:08.141421 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:13:08.141609 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:13:08.141843 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:13:08.142032 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:13:08.142230 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:13:08.146533 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueTestJSON-server-1988772364',display_name='tempest-ServerRescueTestJSON-server-1988772364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverrescuetestjson-server-1988772364',id=90,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5f9f30bee4144fcb8816ddc9af5c936',ramdisk_id='',reservation_id='r-i83e051u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueTestJSON-1540688849',owner_user_name='tempest-ServerRescueTestJSON-1540688849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:13:05Z,user_data=None,user_id='d38980e1b13a4e598718de5500d63c87',uuid=61de9322-0e97-42b2-990b-bd3d934cc215,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3bacf6d-13be-48f5-8924-a141832f639b", "address": "fa:16:3e:83:cd:a1", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bacf6d-13", "ovs_interfaceid": "e3bacf6d-13be-48f5-8924-a141832f639b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:13:08.146806 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Converting VIF {"id": "e3bacf6d-13be-48f5-8924-a141832f639b", "address": "fa:16:3e:83:cd:a1", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bacf6d-13", "ovs_interfaceid": "e3bacf6d-13be-48f5-8924-a141832f639b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:13:08.147589 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:cd:a1,bridge_name='br-int',has_traffic_filtering=True,id=e3bacf6d-13be-48f5-8924-a141832f639b,network=Network(50d5f066-62ba-4607-97e7-f02ccc9e9e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bacf6d-13') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:13:08.148322 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lazy-loading 'pci_devices' on Instance uuid 61de9322-0e97-42b2-990b-bd3d934cc215 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] End _get_guest_xml xml= Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: 61de9322-0e97-42b2-990b-bd3d934cc215 Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: instance-0000005a Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: tempest-ServerRescueTestJSON-server-1988772364 Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:13:08 Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: tempest-ServerRescueTestJSON-1540688849-project-member Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: tempest-ServerRescueTestJSON-1540688849 Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: 61de9322-0e97-42b2-990b-bd3d934cc215 Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: 61de9322-0e97-42b2-990b-bd3d934cc215 Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:08.656542 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:13:08.658865 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Preparing to wait for external event network-vif-plugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:13:08.658865 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:08.658865 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:08.658865 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:08.661287 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueTestJSON-server-1988772364',display_name='tempest-ServerRescueTestJSON-server-1988772364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverrescuetestjson-server-1988772364',id=90,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5f9f30bee4144fcb8816ddc9af5c936',ramdisk_id='',reservation_id='r-i83e051u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueTestJSON-1540688849',owner_user_name='tempest-ServerRescueTestJSON-1540688849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:13:05Z,user_data=None,user_id='d38980e1b13a4e598718de5500d63c87',uuid=61de9322-0e97-42b2-990b-bd3d934cc215,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3bacf6d-13be-48f5-8924-a141832f639b", "address": "fa:16:3e:83:cd:a1", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bacf6d-13", "ovs_interfaceid": "e3bacf6d-13be-48f5-8924-a141832f639b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:13:08.661504 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Converting VIF {"id": "e3bacf6d-13be-48f5-8924-a141832f639b", "address": "fa:16:3e:83:cd:a1", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bacf6d-13", "ovs_interfaceid": "e3bacf6d-13be-48f5-8924-a141832f639b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:13:08.662175 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:cd:a1,bridge_name='br-int',has_traffic_filtering=True,id=e3bacf6d-13be-48f5-8924-a141832f639b,network=Network(50d5f066-62ba-4607-97e7-f02ccc9e9e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bacf6d-13') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:13:08.662467 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:cd:a1,bridge_name='br-int',has_traffic_filtering=True,id=e3bacf6d-13be-48f5-8924-a141832f639b,network=Network(50d5f066-62ba-4607-97e7-f02ccc9e9e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bacf6d-13') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:13:08.663031 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:08.663362 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:13:08.663694 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:13:08.667524 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:08.667524 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31322e62-1f7d-5658-ac76-b029bcf547ac', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:13:08.667524 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:08.671520 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:08.674486 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:08.674733 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3bacf6d-13, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:13:08.675136 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape3bacf6d-13, col_values=(('qos', UUID('b9e40476-bb67-4ff8-8ca8-80c1bf846a63')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:13:08.675377 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape3bacf6d-13, col_values=(('external_ids', {'iface-id': 'e3bacf6d-13be-48f5-8924-a141832f639b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:cd:a1', 'vm-uuid': '61de9322-0e97-42b2-990b-bd3d934cc215'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:13:08.678143 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:08.678946 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:13:08.688073 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:08.688538 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:cd:a1,bridge_name='br-int',has_traffic_filtering=True,id=e3bacf6d-13be-48f5-8924-a141832f639b,network=Network(50d5f066-62ba-4607-97e7-f02ccc9e9e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bacf6d-13') Jan 26 19:13:10.221646 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:13:10.222102 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:13:10.222102 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] No VIF found with MAC fa:16:3e:83:cd:a1, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:13:10.222685 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Using config drive Jan 26 19:13:10.484727 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lazy-loading 'flavor' on Instance uuid 295123b2-57e9-4b0d-af2d-70b35167f85e {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:13:10.733112 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:13:10.864809 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Creating config drive at /opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk.config Jan 26 19:13:10.866211 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp659irxv5 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:10.995591 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp659irxv5" returned: 0 in 0.129s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:11.105815 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:11.115717 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:11.261908 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:11.263260 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:11.272116 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:13:11.272382 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] VM Started (Lifecycle Event) Jan 26 19:13:11.283856 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-dc507302-dac1-4664-bdd5-84a8fd757048 req-e712488c-f9b2-42b3-9efa-90657606b803 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received event network-vif-plugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:13:11.284118 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-dc507302-dac1-4664-bdd5-84a8fd757048 req-e712488c-f9b2-42b3-9efa-90657606b803 service nova] Acquiring lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:11.284331 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-dc507302-dac1-4664-bdd5-84a8fd757048 req-e712488c-f9b2-42b3-9efa-90657606b803 service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:11.284654 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-dc507302-dac1-4664-bdd5-84a8fd757048 req-e712488c-f9b2-42b3-9efa-90657606b803 service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:11.285121 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-dc507302-dac1-4664-bdd5-84a8fd757048 req-e712488c-f9b2-42b3-9efa-90657606b803 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Processing event network-vif-plugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:13:11.286348 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:13:11.289734 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:13:11.296576 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Instance spawned successfully. Jan 26 19:13:11.296906 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:13:11.494884 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-65f22bd3-e5e9-4759-9773-3767d3aaeb92 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 5.503s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:11.572559 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Acquiring lock "295123b2-57e9-4b0d-af2d-70b35167f85e" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:11.572864 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:11.775989 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:13:11.778267 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:13:11.804189 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:13:11.804358 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:13:11.804701 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:13:11.804997 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:13:11.805368 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:13:11.805627 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:13:12.076887 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Detaching volume 9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 Jan 26 19:13:12.129413 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.block_device [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Attempting to driver detach volume 9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 from mountpoint /dev/vdc Jan 26 19:13:12.135847 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Found disk vdc by alias ua-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:13:12.136748 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Found disk vdc by alias ua-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:13:12.136978 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Attempting to detach device vdc from instance 295123b2-57e9-4b0d-af2d-70b35167f85e from the persistent domain config. {{(pid=189076) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2599}} Jan 26 19:13:12.137387 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] detach device xml: Jan 26 19:13:12.137387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:12.137387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:12.137387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:12.137387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:12.137387 np0005596550.novalocal nova-compute[189076]: 9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 Jan 26 19:13:12.137387 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:13:12.137387 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:12.137387 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:13:12.148783 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Found disk vdc by alias ua-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:13:12.148979 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Failed to detach device vdc from instance 295123b2-57e9-4b0d-af2d-70b35167f85e from the persistent domain config. Libvirt did not report any error but the device is still in the config. Jan 26 19:13:12.149219 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] (1/8): Attempting to detach device vdc with device alias ua-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 from instance 295123b2-57e9-4b0d-af2d-70b35167f85e from the live domain config. {{(pid=189076) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2633}} Jan 26 19:13:12.149699 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] detach device xml: Jan 26 19:13:12.149699 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:12.149699 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:12.149699 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:12.149699 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:12.149699 np0005596550.novalocal nova-compute[189076]: 9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 Jan 26 19:13:12.149699 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:13:12.149699 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:12.149699 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:13:12.267043 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 for instance 295123b2-57e9-4b0d-af2d-70b35167f85e {{(pid=189076) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2713}} Jan 26 19:13:12.280718 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:13:12.280964 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:13:12.281139 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] VM Paused (Lifecycle Event) Jan 26 19:13:12.310216 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Took 5.89 seconds to spawn the instance on the hypervisor. Jan 26 19:13:12.310364 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:13:12.784745 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:13:12.790096 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:13:12.790252 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] VM Resumed (Lifecycle Event) Jan 26 19:13:12.819085 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Took 11.63 seconds to build instance. Jan 26 19:13:12.905604 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:13.293654 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:13:13.297205 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:13:13.320970 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3c9c27f5-7037-4fbb-bfe9-608dcfb54095 req-c6beabcc-6850-47b4-8152-3bc2e3b31123 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received event network-vif-plugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:13:13.321136 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3c9c27f5-7037-4fbb-bfe9-608dcfb54095 req-c6beabcc-6850-47b4-8152-3bc2e3b31123 service nova] Acquiring lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:13.321462 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3c9c27f5-7037-4fbb-bfe9-608dcfb54095 req-c6beabcc-6850-47b4-8152-3bc2e3b31123 service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:13.321855 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3c9c27f5-7037-4fbb-bfe9-608dcfb54095 req-c6beabcc-6850-47b4-8152-3bc2e3b31123 service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:13.322241 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3c9c27f5-7037-4fbb-bfe9-608dcfb54095 req-c6beabcc-6850-47b4-8152-3bc2e3b31123 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] No waiting events found dispatching network-vif-plugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:13:13.322450 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-3c9c27f5-7037-4fbb-bfe9-608dcfb54095 req-c6beabcc-6850-47b4-8152-3bc2e3b31123 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received unexpected event network-vif-plugged-e3bacf6d-13be-48f5-8924-a141832f639b for instance with vm_state active and task_state None. Jan 26 19:13:13.323379 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2298adcf-5a5a-4182-8062-56103eff6b17 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "61de9322-0e97-42b2-990b-bd3d934cc215" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 13.138s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:13.718413 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:13.801523 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Received event ua-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6> from libvirt while the driver is waiting for it; dispatched. {{(pid=189076) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2486}} Jan 26 19:13:13.807154 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Successfully detached device vdc from instance 295123b2-57e9-4b0d-af2d-70b35167f85e from the live domain config. Jan 26 19:13:13.808079 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] calling os-brick to detach iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jan 26 19:13:13.808734 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6', 'target_lun': 0, 'volume_id': '9b5f535f-532a-41aa-84ad-d1d38c3cf3b6', 'auth_method': 'CHAP', 'auth_username': 'kk6eN4Vh8nEkR8wjYtCF', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:13:13.808906 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:13:13.809232 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:13:13.810407 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:13.820137 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:13.820416 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d16118c-97d8-4754-84a3-d1ae55664987]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:13.821542 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:13:13.821542 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:13:13.821542 np0005596550.novalocal nova-compute[189076]: iSNS: Jan 26 19:13:13.821542 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:13:13.821542 np0005596550.novalocal nova-compute[189076]: STATIC: Jan 26 19:13:13.821542 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 Jan 26 19:13:13.821542 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:13:13.821542 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:13:13.821542 np0005596550.novalocal nova-compute[189076]: FIRMWARE: Jan 26 19:13:13.821542 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:13:13.821542 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:13:13.821888 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:13:13.821888 np0005596550.novalocal nova-compute[189076]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:13:13.821888 np0005596550.novalocal nova-compute[189076]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=189076) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:13:13.822318 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6', 0)] {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:13:13.823174 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:13.833051 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:13.833972 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[235be562-0add-4369-b95f-7819c984071d]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:13.837160 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:13.843830 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:13.845699 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e182a28-4b81-49bb-a938-78e4801233ad]: (4, ('tcp: [20] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:13.845699 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 (non-flash) Jan 26 19:13:13.845699 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:13:13.845699 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsi session list stdout=tcp: [20] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 (non-flash) Jan 26 19:13:13.845699 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:13:13.845699 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Resulting device map defaultdict(. at 0x7fd75079cd60>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6'): ({'sdc'}, set())}) {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:13:13.845699 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Removing single pathed devices sdc {{(pid=189076) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:13:13.846099 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:13.852330 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:13:13.853617 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[c1eef4aa-87a9-4196-a967-3f54da7dbdbb]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:13:13.853617 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:13:13.853617 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:13:13.853617 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:13:13.853617 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:13.853617 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:13:13.853617 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:13:13.853617 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:13.853617 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:13:13.853617 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:13:13.853617 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:13.853617 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:13:13.853617 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:13:13.853617 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:13.853617 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:13:13.853617 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:13:13.853617 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:13.853617 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:13:13.853617 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:13:13.853617 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:13:13.853617 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:13:13.853617 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:13:13.855570 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1eef4aa-87a9-4196-a967-3f54da7dbdbb]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:13.856153 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Flushing IO for device /dev/sdc {{(pid=189076) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:13:13.858023 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:13.863210 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.006s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:13.863905 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c5b60e-56c6-4416-9785-ee37aa1dd082]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:13.864299 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=189076) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:13:13.864983 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:13.920348 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:13.920658 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c4e049-01ea-454b-b653-538c62100a4b]: (4, ('1', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:13.921087 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:13:13.921332 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] SCSI volumes sdc have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:13:13.921640 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6')] {{(pid=189076) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:13:13.922705 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:13.934121 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:13.934274 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fd1c50-dbbb-4c80-9d44-25083824e961]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:13.934605 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:13.939010 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260 --logout {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:13.973686 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260 --logout" returned: 0 in 0.038s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:13.974338 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71d2c55-4557-4b7c-a7fe-4678a752b419]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6, portal: 38.102.83.18,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:13.974689 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6, portal: 38.102.83.18,3260] Jan 26 19:13:13.974689 np0005596550.novalocal nova-compute[189076]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6, portal: 38.102.83.18,3260] successful. Jan 26 19:13:13.974689 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:13.976240 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260 --op delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:13.985244 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 -p 38.102.83.18:3260 --op delete" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:13.985405 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a776f6-1938-4599-8a10-d57b7fe25ad3]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:13.985823 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:13.986250 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.177s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:13:13.986446 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] <== disconnect_volume: return (177ms) None {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:13:13.986631 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Disconnected iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jan 26 19:13:14.061355 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Rescuing Jan 26 19:13:14.061470 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "refresh_cache-61de9322-0e97-42b2-990b-bd3d934cc215" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:13:14.062846 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquired lock "refresh_cache-61de9322-0e97-42b2-990b-bd3d934cc215" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:13:14.062846 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:13:14.567848 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:13:14.920171 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:13:15.081472 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Updating instance_info_cache with network_info: [{"id": "e3bacf6d-13be-48f5-8924-a141832f639b", "address": "fa:16:3e:83:cd:a1", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bacf6d-13", "ovs_interfaceid": "e3bacf6d-13be-48f5-8924-a141832f639b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:13:15.584698 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Releasing lock "refresh_cache-61de9322-0e97-42b2-990b-bd3d934cc215" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:13:17.254735 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:17.378170 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d6a2c3e0-4754-43eb-9a11-c7786caecdd3 req-31376c27-4d42-4789-8b94-1ecbc9fddd44 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received event network-vif-unplugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:13:17.378170 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d6a2c3e0-4754-43eb-9a11-c7786caecdd3 req-31376c27-4d42-4789-8b94-1ecbc9fddd44 service nova] Acquiring lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:17.378170 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d6a2c3e0-4754-43eb-9a11-c7786caecdd3 req-31376c27-4d42-4789-8b94-1ecbc9fddd44 service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:17.378334 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d6a2c3e0-4754-43eb-9a11-c7786caecdd3 req-31376c27-4d42-4789-8b94-1ecbc9fddd44 service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:17.378484 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d6a2c3e0-4754-43eb-9a11-c7786caecdd3 req-31376c27-4d42-4789-8b94-1ecbc9fddd44 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] No waiting events found dispatching network-vif-unplugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:13:17.378698 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-d6a2c3e0-4754-43eb-9a11-c7786caecdd3 req-31376c27-4d42-4789-8b94-1ecbc9fddd44 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received unexpected event network-vif-unplugged-e3bacf6d-13be-48f5-8924-a141832f639b for instance with vm_state active and task_state rescuing. Jan 26 19:13:17.397157 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:17.403876 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:17.431327 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:17.476539 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Instance destroyed successfully. Jan 26 19:13:17.476909 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lazy-loading 'numa_topology' on Instance uuid 61de9322-0e97-42b2-990b-bd3d934cc215 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:13:17.557393 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lazy-loading 'flavor' on Instance uuid 295123b2-57e9-4b0d-af2d-70b35167f85e {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:13:17.895946 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:13:17.909581 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:17.984372 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Attempting rescue Jan 26 19:13:17.984372 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=189076) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4599}} Jan 26 19:13:17.988706 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Instance directory exists: not creating {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5157}} Jan 26 19:13:17.988907 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Creating image(s) Jan 26 19:13:17.989535 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "/opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:17.989711 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "/opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:17.990222 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "/opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:17.990401 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lazy-loading 'trusted_certs' on Instance uuid 61de9322-0e97-42b2-990b-bd3d934cc215 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:13:18.400837 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:18.401844 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:18.401844 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:18.401844 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:13:18.493408 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Object Instance<61de9322-0e97-42b2-990b-bd3d934cc215> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:13:18.494610 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:13:18.502000 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:13:18.504988 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:18.505615 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:18.506626 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:13:18.512306 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:13:18.512735 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:18.571337 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6d950fb2-123b-4c6a-b4ff-81b35446d9df tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 6.998s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:18.613624 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.100s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:18.614026 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk.rescue {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:18.682893 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk.rescue" returned: 0 in 0.068s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:18.683196 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.178s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:18.683455 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lazy-loading 'migration_context' on Instance uuid 61de9322-0e97-42b2-990b-bd3d934cc215 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:13:18.757566 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:19.190721 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Object Instance<61de9322-0e97-42b2-990b-bd3d934cc215> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:13:19.191517 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:13:19.193570 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Start _get_guest_xml network_info=[{"id": "e3bacf6d-13be-48f5-8924-a141832f639b", "address": "fa:16:3e:83:cd:a1", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueTestJSON-1607741291-network", "vif_mac": "fa:16:3e:83:cd:a1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bacf6d-13", "ovs_interfaceid": "e3bacf6d-13be-48f5-8924-a141832f639b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue={'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:13:19.194133 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lazy-loading 'resources' on Instance uuid 61de9322-0e97-42b2-990b-bd3d934cc215 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:13:19.423330 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-bec4b63d-62ca-4cc8-b345-01da569b895f req-d57039da-35ff-400a-a723-e2f4060dffdf service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received event network-vif-unplugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:13:19.423823 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-bec4b63d-62ca-4cc8-b345-01da569b895f req-d57039da-35ff-400a-a723-e2f4060dffdf service nova] Acquiring lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:19.423823 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-bec4b63d-62ca-4cc8-b345-01da569b895f req-d57039da-35ff-400a-a723-e2f4060dffdf service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:19.424214 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-bec4b63d-62ca-4cc8-b345-01da569b895f req-d57039da-35ff-400a-a723-e2f4060dffdf service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:19.424214 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-bec4b63d-62ca-4cc8-b345-01da569b895f req-d57039da-35ff-400a-a723-e2f4060dffdf service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] No waiting events found dispatching network-vif-unplugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:13:19.424255 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-bec4b63d-62ca-4cc8-b345-01da569b895f req-d57039da-35ff-400a-a723-e2f4060dffdf service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received unexpected event network-vif-unplugged-e3bacf6d-13be-48f5-8924-a141832f639b for instance with vm_state active and task_state rescuing. Jan 26 19:13:19.433014 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk.rescue --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:19.541840 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk.rescue --force-share --output=json" returned: 0 in 0.109s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:19.542255 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk.rescue --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:19.556155 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Acquiring lock "295123b2-57e9-4b0d-af2d-70b35167f85e" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:19.556456 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:19.556663 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Acquiring lock "295123b2-57e9-4b0d-af2d-70b35167f85e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:19.556833 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:19.557025 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:19.560228 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Terminating instance Jan 26 19:13:19.641264 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk.rescue --force-share --output=json" returned: 0 in 0.099s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:19.641789 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:19.699283 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Object Instance<61de9322-0e97-42b2-990b-bd3d934cc215> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:13:19.704787 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:13:19.704787 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueTestJSON-server-1988772364', uuid='61de9322-0e97-42b2-990b-bd3d934cc215'), owner=OwnerMeta(userid='d38980e1b13a4e598718de5500d63c87', username='tempest-ServerRescueTestJSON-1540688849-project-member', projectid='d5f9f30bee4144fcb8816ddc9af5c936', projectname='tempest-ServerRescueTestJSON-1540688849'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e3bacf6d-13be-48f5-8924-a141832f639b", "address": "fa:16:3e:83:cd:a1", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueTestJSON-1607741291-network", "vif_mac": "fa:16:3e:83:cd:a1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bacf6d-13", "ovs_interfaceid": "e3bacf6d-13be-48f5-8924-a141832f639b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472799.7039237) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:13:19.707088 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:13:19.707522 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:13:19.710378 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:13:19.711337 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:13:19.713232 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:13:19.713808 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:13:19.714315 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:13:19.714500 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:13:19.715118 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:13:19.715296 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:13:19.715470 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:13:19.715731 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:13:19.715937 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:13:19.716140 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:13:19.716378 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:13:19.716655 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:13:19.716978 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lazy-loading 'vcpu_model' on Instance uuid 61de9322-0e97-42b2-990b-bd3d934cc215 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:13:19.720996 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:19.721578 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:19.800682 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:19.806557 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/295123b2-57e9-4b0d-af2d-70b35167f85e/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:19.908605 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/295123b2-57e9-4b0d-af2d-70b35167f85e/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:19.909182 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/295123b2-57e9-4b0d-af2d-70b35167f85e/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:20.001079 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/295123b2-57e9-4b0d-af2d-70b35167f85e/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:20.006542 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:20.064813 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:13:20.125005 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:20.126883 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:20.126883 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:20.144693 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:20.169403 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:20.186872 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:20.222336 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Object Instance<61de9322-0e97-42b2-990b-bd3d934cc215> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:13:20.234367 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueTestJSON-server-1988772364',display_name='tempest-ServerRescueTestJSON-server-1988772364',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverrescuetestjson-server-1988772364',id=90,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:13:12Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='d5f9f30bee4144fcb8816ddc9af5c936',ramdisk_id='',reservation_id='r-i83e051u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueTestJSON-1540688849',owner_user_name='tempest-ServerRescueTestJSON-1540688849-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:13:12Z,user_data=None,user_id='d38980e1b13a4e598718de5500d63c87',uuid=61de9322-0e97-42b2-990b-bd3d934cc215,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3bacf6d-13be-48f5-8924-a141832f639b", "address": "fa:16:3e:83:cd:a1", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueTestJSON-1607741291-network", "vif_mac": "fa:16:3e:83:cd:a1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bacf6d-13", "ovs_interfaceid": "e3bacf6d-13be-48f5-8924-a141832f639b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:13:20.234367 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Converting VIF {"id": "e3bacf6d-13be-48f5-8924-a141832f639b", "address": "fa:16:3e:83:cd:a1", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueTestJSON-1607741291-network", "vif_mac": "fa:16:3e:83:cd:a1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bacf6d-13", "ovs_interfaceid": "e3bacf6d-13be-48f5-8924-a141832f639b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:13:20.234367 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:cd:a1,bridge_name='br-int',has_traffic_filtering=True,id=e3bacf6d-13be-48f5-8924-a141832f639b,network=Network(50d5f066-62ba-4607-97e7-f02ccc9e9e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bacf6d-13') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:13:20.234560 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lazy-loading 'pci_devices' on Instance uuid 61de9322-0e97-42b2-990b-bd3d934cc215 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:13:20.234560 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:20.279687 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b4dfb743-5321-4173-b94d-0d17d262a10f req-fd4f0f6f-773d-4b8f-8ed6-d0851cbb32ce service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Received event network-vif-unplugged-cc5b7109-a943-4e78-88d8-b227cad663ea {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:13:20.279890 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b4dfb743-5321-4173-b94d-0d17d262a10f req-fd4f0f6f-773d-4b8f-8ed6-d0851cbb32ce service nova] Acquiring lock "295123b2-57e9-4b0d-af2d-70b35167f85e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:20.280092 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b4dfb743-5321-4173-b94d-0d17d262a10f req-fd4f0f6f-773d-4b8f-8ed6-d0851cbb32ce service nova] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:20.280235 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b4dfb743-5321-4173-b94d-0d17d262a10f req-fd4f0f6f-773d-4b8f-8ed6-d0851cbb32ce service nova] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:20.280383 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b4dfb743-5321-4173-b94d-0d17d262a10f req-fd4f0f6f-773d-4b8f-8ed6-d0851cbb32ce service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] No waiting events found dispatching network-vif-unplugged-cc5b7109-a943-4e78-88d8-b227cad663ea {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:13:20.280534 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b4dfb743-5321-4173-b94d-0d17d262a10f req-fd4f0f6f-773d-4b8f-8ed6-d0851cbb32ce service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Received event network-vif-unplugged-cc5b7109-a943-4e78-88d8-b227cad663ea for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:13:20.304844 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:20.314273 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:20.351638 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Instance destroyed successfully. Jan 26 19:13:20.352847 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lazy-loading 'resources' on Instance uuid 295123b2-57e9-4b0d-af2d-70b35167f85e {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:13:20.478585 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:13:20.479745 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:20.520037 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.040s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:20.520440 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=7146MB free_disk=373.0180435180664GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:13:20.520662 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:20.521035 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:20.736394 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Object Instance<61de9322-0e97-42b2-990b-bd3d934cc215> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] End _get_guest_xml xml= Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: 61de9322-0e97-42b2-990b-bd3d934cc215 Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: instance-0000005a Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: tempest-ServerRescueTestJSON-server-1988772364 Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:13:19 Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: ide Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: pc Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: tempest-ServerRescueTestJSON-1540688849-project-member Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: tempest-ServerRescueTestJSON-1540688849 Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: 61de9322-0e97-42b2-990b-bd3d934cc215 Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: 61de9322-0e97-42b2-990b-bd3d934cc215 Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: Jan 26 19:13:20.739128 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:13:20.749551 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Instance destroyed successfully. Jan 26 19:13:20.855889 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:11:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1847419248',display_name='tempest-AttachVolumeTestJSON-server-1847419248',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-attachvolumetestjson-server-1847419248',id=87,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjIx72cGhWreJ9aMCJ+fBQesmw+C4CWR414emjxuHG0Q3DEScFjUPGXvofUmC+Yy0Pudq4f8SK638hrVj3CzKz+Gpicl6vJaZPvnAjOcGg7DaZWWaASKylgWyZks/AesQ==',key_name='tempest-keypair-622269626',keypairs=,launch_index=0,launched_at=2026-01-27T00:12:01Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='e10cba04043c48658cbbee662762e008',ramdisk_id='',reservation_id='r-75nsvojv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-122772367',owner_user_name='tempest-AttachVolumeTestJSON-122772367-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:12:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1ad7e0e2a844767a6a58b19724cbd46',uuid=295123b2-57e9-4b0d-af2d-70b35167f85e,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc5b7109-a943-4e78-88d8-b227cad663ea", "address": "fa:16:3e:64:d9:5d", "network": {"id": "1bb29ea3-f12e-4ae7-9373-18004c925377", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46476615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10cba04043c48658cbbee662762e008", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5b7109-a9", "ovs_interfaceid": "cc5b7109-a943-4e78-88d8-b227cad663ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:13:20.856221 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Converting VIF {"id": "cc5b7109-a943-4e78-88d8-b227cad663ea", "address": "fa:16:3e:64:d9:5d", "network": {"id": "1bb29ea3-f12e-4ae7-9373-18004c925377", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46476615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e10cba04043c48658cbbee662762e008", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5b7109-a9", "ovs_interfaceid": "cc5b7109-a943-4e78-88d8-b227cad663ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:13:20.856633 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:d9:5d,bridge_name='br-int',has_traffic_filtering=True,id=cc5b7109-a943-4e78-88d8-b227cad663ea,network=Network(1bb29ea3-f12e-4ae7-9373-18004c925377),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc5b7109-a9') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:13:20.856904 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:d9:5d,bridge_name='br-int',has_traffic_filtering=True,id=cc5b7109-a943-4e78-88d8-b227cad663ea,network=Network(1bb29ea3-f12e-4ae7-9373-18004c925377),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc5b7109-a9') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:13:20.858419 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:20.858753 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc5b7109-a9, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:13:20.860197 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:20.861736 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:13:20.868118 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:20.868960 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:20.869336 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30233e07-423a-48c6-90d5-74a97ca066c2) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:13:20.870233 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:20.873104 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:13:20.876929 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:20.879913 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:d9:5d,bridge_name='br-int',has_traffic_filtering=True,id=cc5b7109-a943-4e78-88d8-b227cad663ea,network=Network(1bb29ea3-f12e-4ae7-9373-18004c925377),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc5b7109-a9') Jan 26 19:13:20.880557 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Deleting instance files /opt/stack/data/nova/instances/295123b2-57e9-4b0d-af2d-70b35167f85e_del Jan 26 19:13:20.881388 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Deletion of /opt/stack/data/nova/instances/295123b2-57e9-4b0d-af2d-70b35167f85e_del complete Jan 26 19:13:21.398004 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Took 1.33 seconds to destroy the instance on the hypervisor. Jan 26 19:13:21.398580 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:13:21.399041 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:13:21.399267 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:13:21.400062 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:13:21.481893 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:13:21.611192 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 295123b2-57e9-4b0d-af2d-70b35167f85e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:13:21.611297 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance d262fe4c-575d-4eb7-a180-467686ddeec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:13:21.611417 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 61de9322-0e97-42b2-990b-bd3d934cc215 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:13:21.611597 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 3 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:13:21.611747 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=1088MB phys_disk=399GB used_disk=3GB total_vcpus=8 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:13:20 up 41 min, 14 users, load average: 4.39, 4.94, 4.22\n', 'num_instances': '3', 'num_vm_active': '2', 'num_task_deleting': '1', 'num_os_type_None': '3', 'num_proj_e10cba04043c48658cbbee662762e008': '1', 'io_workload': '1', 'num_vm_rescued': '1', 'num_task_None': '1', 'num_proj_d5f9f30bee4144fcb8816ddc9af5c936': '2', 'num_task_rescuing': '1'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:13:21.748281 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:13:22.250820 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:13:22.285797 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:13:22.285936 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] No BDM found with device name vdb, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:13:22.286144 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:13:22.286358 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] No VIF found with MAC fa:16:3e:83:cd:a1, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:13:22.286972 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Using config drive Jan 26 19:13:22.343853 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f28737aa-7e61-4c2c-996b-489d3ebb76ba req-8fdd6d38-5047-4299-9ff4-6bffcc0d6098 service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Received event network-vif-unplugged-cc5b7109-a943-4e78-88d8-b227cad663ea {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:13:22.344625 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f28737aa-7e61-4c2c-996b-489d3ebb76ba req-8fdd6d38-5047-4299-9ff4-6bffcc0d6098 service nova] Acquiring lock "295123b2-57e9-4b0d-af2d-70b35167f85e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:22.344862 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f28737aa-7e61-4c2c-996b-489d3ebb76ba req-8fdd6d38-5047-4299-9ff4-6bffcc0d6098 service nova] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:22.345016 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f28737aa-7e61-4c2c-996b-489d3ebb76ba req-8fdd6d38-5047-4299-9ff4-6bffcc0d6098 service nova] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:22.345172 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f28737aa-7e61-4c2c-996b-489d3ebb76ba req-8fdd6d38-5047-4299-9ff4-6bffcc0d6098 service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] No waiting events found dispatching network-vif-unplugged-cc5b7109-a943-4e78-88d8-b227cad663ea {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:13:22.345345 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f28737aa-7e61-4c2c-996b-489d3ebb76ba req-8fdd6d38-5047-4299-9ff4-6bffcc0d6098 service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Received event network-vif-unplugged-cc5b7109-a943-4e78-88d8-b227cad663ea for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:13:22.345482 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f28737aa-7e61-4c2c-996b-489d3ebb76ba req-8fdd6d38-5047-4299-9ff4-6bffcc0d6098 service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Received event network-vif-deleted-cc5b7109-a943-4e78-88d8-b227cad663ea {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:13:22.345628 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-f28737aa-7e61-4c2c-996b-489d3ebb76ba req-8fdd6d38-5047-4299-9ff4-6bffcc0d6098 service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Neutron deleted interface cc5b7109-a943-4e78-88d8-b227cad663ea; detaching it from the instance and deleting it from the info cache Jan 26 19:13:22.345872 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-f28737aa-7e61-4c2c-996b-489d3ebb76ba req-8fdd6d38-5047-4299-9ff4-6bffcc0d6098 service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:13:22.437200 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:13:22.758962 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:13:22.758962 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.238s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:22.790124 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lazy-loading 'ec2_ids' on Instance uuid 61de9322-0e97-42b2-990b-bd3d934cc215 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:13:22.850321 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f28737aa-7e61-4c2c-996b-489d3ebb76ba req-8fdd6d38-5047-4299-9ff4-6bffcc0d6098 service nova] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Detach interface failed, port_id=cc5b7109-a943-4e78-88d8-b227cad663ea, reason: Instance 295123b2-57e9-4b0d-af2d-70b35167f85e could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:13:22.949281 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Took 1.54 seconds to deallocate network for instance. Jan 26 19:13:22.951971 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:23.293659 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Object Instance<61de9322-0e97-42b2-990b-bd3d934cc215> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:13:23.293783 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lazy-loading 'keypairs' on Instance uuid 61de9322-0e97-42b2-990b-bd3d934cc215 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:13:23.448185 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:23.448485 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:23.598337 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:13:23.796245 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Object Instance<61de9322-0e97-42b2-990b-bd3d934cc215> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:13:23.800956 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:13:23.899508 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Creating config drive at /opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk.config.rescue Jan 26 19:13:23.905217 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpq064ym8v {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:24.028843 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpq064ym8v" returned: 0 in 0.123s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:24.104159 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:13:24.153691 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:24.160649 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:24.289189 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:24.290492 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:24.294562 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-44081d8c-064f-48a5-968b-e4aa9a906c33 req-c247cd9b-ca01-4da9-b3ac-b294c59ff3e8 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received event network-vif-plugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:13:24.294867 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-44081d8c-064f-48a5-968b-e4aa9a906c33 req-c247cd9b-ca01-4da9-b3ac-b294c59ff3e8 service nova] Acquiring lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:24.294973 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-44081d8c-064f-48a5-968b-e4aa9a906c33 req-c247cd9b-ca01-4da9-b3ac-b294c59ff3e8 service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:24.295116 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-44081d8c-064f-48a5-968b-e4aa9a906c33 req-c247cd9b-ca01-4da9-b3ac-b294c59ff3e8 service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:24.296578 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-44081d8c-064f-48a5-968b-e4aa9a906c33 req-c247cd9b-ca01-4da9-b3ac-b294c59ff3e8 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] No waiting events found dispatching network-vif-plugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:13:24.296578 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-44081d8c-064f-48a5-968b-e4aa9a906c33 req-c247cd9b-ca01-4da9-b3ac-b294c59ff3e8 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received unexpected event network-vif-plugged-e3bacf6d-13be-48f5-8924-a141832f639b for instance with vm_state active and task_state rescuing. Jan 26 19:13:24.339169 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for 61de9322-0e97-42b2-990b-bd3d934cc215 due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:13:24.339747 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:13:24.341052 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] VM Resumed (Lifecycle Event) Jan 26 19:13:24.351038 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-839f2c32-d5f0-403a-850c-19b0595f63a6 tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:13:24.611214 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.163s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:24.684531 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Deleted allocations for instance 295123b2-57e9-4b0d-af2d-70b35167f85e Jan 26 19:13:24.759384 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:13:24.759659 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:13:24.759816 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:13:24.847698 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:13:24.853186 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:13:24.894842 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:13:25.357589 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:13:25.357790 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] VM Started (Lifecycle Event) Jan 26 19:13:25.541439 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-621a1504-c927-468a-9e75-e493340a47cc tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Unrescuing Jan 26 19:13:25.541692 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-621a1504-c927-468a-9e75-e493340a47cc tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "refresh_cache-61de9322-0e97-42b2-990b-bd3d934cc215" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:13:25.541890 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-621a1504-c927-468a-9e75-e493340a47cc tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquired lock "refresh_cache-61de9322-0e97-42b2-990b-bd3d934cc215" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:13:25.542092 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-621a1504-c927-468a-9e75-e493340a47cc tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:13:25.695048 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c5680076-57bb-4749-b321-6d8e4e6998b8 tempest-AttachVolumeTestJSON-122772367 tempest-AttachVolumeTestJSON-122772367-project-member] Lock "295123b2-57e9-4b0d-af2d-70b35167f85e" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.138s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:25.863384 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:13:25.867644 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:13:25.904065 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:26.046094 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-621a1504-c927-468a-9e75-e493340a47cc tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:13:26.347145 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-9d7beb9e-7716-4dfb-963d-1981abf643c6 req-07dbd587-04bc-4fd7-9242-77e6ad67d3bd service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received event network-vif-plugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:13:26.347145 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-9d7beb9e-7716-4dfb-963d-1981abf643c6 req-07dbd587-04bc-4fd7-9242-77e6ad67d3bd service nova] Acquiring lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:26.347145 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-9d7beb9e-7716-4dfb-963d-1981abf643c6 req-07dbd587-04bc-4fd7-9242-77e6ad67d3bd service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:26.347145 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-9d7beb9e-7716-4dfb-963d-1981abf643c6 req-07dbd587-04bc-4fd7-9242-77e6ad67d3bd service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:26.347145 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-9d7beb9e-7716-4dfb-963d-1981abf643c6 req-07dbd587-04bc-4fd7-9242-77e6ad67d3bd service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] No waiting events found dispatching network-vif-plugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:13:26.347145 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-9d7beb9e-7716-4dfb-963d-1981abf643c6 req-07dbd587-04bc-4fd7-9242-77e6ad67d3bd service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received unexpected event network-vif-plugged-e3bacf6d-13be-48f5-8924-a141832f639b for instance with vm_state rescued and task_state unrescuing. Jan 26 19:13:26.352791 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-621a1504-c927-468a-9e75-e493340a47cc tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:13:26.373266 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] During sync_power_state the instance has a pending task (unrescuing). Skip. Jan 26 19:13:26.472779 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-621a1504-c927-468a-9e75-e493340a47cc tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Updating instance_info_cache with network_info: [{"id": "e3bacf6d-13be-48f5-8924-a141832f639b", "address": "fa:16:3e:83:cd:a1", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bacf6d-13", "ovs_interfaceid": "e3bacf6d-13be-48f5-8924-a141832f639b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:13:26.895518 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:13:26.895710 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:13:26.978679 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-621a1504-c927-468a-9e75-e493340a47cc tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Releasing lock "refresh_cache-61de9322-0e97-42b2-990b-bd3d934cc215" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:13:26.979340 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-621a1504-c927-468a-9e75-e493340a47cc tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lazy-loading 'flavor' on Instance uuid 61de9322-0e97-42b2-990b-bd3d934cc215 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:13:27.516302 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:27.520787 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:27.652185 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:27.657863 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:27.780477 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Instance destroyed successfully. Jan 26 19:13:27.780896 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-621a1504-c927-468a-9e75-e493340a47cc tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lazy-loading 'numa_topology' on Instance uuid 61de9322-0e97-42b2-990b-bd3d934cc215 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:13:27.891278 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:13:27.894885 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:13:27.953118 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:28.287852 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-621a1504-c927-468a-9e75-e493340a47cc tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Object Instance<61de9322-0e97-42b2-990b-bd3d934cc215> lazy-loaded attributes: flavor,numa_topology {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:13:28.401607 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:28.410107 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:28.481810 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4e805cb2-2c17-4274-898e-7f963e0df7ff req-fcdcf93d-32a6-478a-853f-83bb8f42ec04 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received event network-vif-unplugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:13:28.484848 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4e805cb2-2c17-4274-898e-7f963e0df7ff req-fcdcf93d-32a6-478a-853f-83bb8f42ec04 service nova] Acquiring lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:28.484848 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4e805cb2-2c17-4274-898e-7f963e0df7ff req-fcdcf93d-32a6-478a-853f-83bb8f42ec04 service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.004s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:28.484848 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4e805cb2-2c17-4274-898e-7f963e0df7ff req-fcdcf93d-32a6-478a-853f-83bb8f42ec04 service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:28.484848 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4e805cb2-2c17-4274-898e-7f963e0df7ff req-fcdcf93d-32a6-478a-853f-83bb8f42ec04 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] No waiting events found dispatching network-vif-unplugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:13:28.486279 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-4e805cb2-2c17-4274-898e-7f963e0df7ff req-fcdcf93d-32a6-478a-853f-83bb8f42ec04 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received unexpected event network-vif-unplugged-e3bacf6d-13be-48f5-8924-a141832f639b for instance with vm_state rescued and task_state unrescuing. Jan 26 19:13:28.486501 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4e805cb2-2c17-4274-898e-7f963e0df7ff req-fcdcf93d-32a6-478a-853f-83bb8f42ec04 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received event network-vif-unplugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:13:28.486653 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4e805cb2-2c17-4274-898e-7f963e0df7ff req-fcdcf93d-32a6-478a-853f-83bb8f42ec04 service nova] Acquiring lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:28.486919 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4e805cb2-2c17-4274-898e-7f963e0df7ff req-fcdcf93d-32a6-478a-853f-83bb8f42ec04 service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:28.487095 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4e805cb2-2c17-4274-898e-7f963e0df7ff req-fcdcf93d-32a6-478a-853f-83bb8f42ec04 service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:28.487248 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4e805cb2-2c17-4274-898e-7f963e0df7ff req-fcdcf93d-32a6-478a-853f-83bb8f42ec04 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] No waiting events found dispatching network-vif-unplugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:13:28.487391 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-4e805cb2-2c17-4274-898e-7f963e0df7ff req-fcdcf93d-32a6-478a-853f-83bb8f42ec04 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received unexpected event network-vif-unplugged-e3bacf6d-13be-48f5-8924-a141832f639b for instance with vm_state rescued and task_state unrescuing. Jan 26 19:13:28.562689 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:28.605794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for 61de9322-0e97-42b2-990b-bd3d934cc215 due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:13:28.605794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:13:28.605794 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] VM Resumed (Lifecycle Event) Jan 26 19:13:28.616809 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-621a1504-c927-468a-9e75-e493340a47cc tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:13:29.108841 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:13:29.116338 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:13:29.610456 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "61de9322-0e97-42b2-990b-bd3d934cc215" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:29.610801 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "61de9322-0e97-42b2-990b-bd3d934cc215" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:29.611123 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:29.611365 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:29.612168 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:29.615553 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Terminating instance Jan 26 19:13:29.623891 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] During sync_power_state the instance has a pending task (deleting). Skip. Jan 26 19:13:29.624255 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:13:29.625542 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] VM Started (Lifecycle Event) Jan 26 19:13:30.122803 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:13:30.128454 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:13:30.152445 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:30.163906 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:30.296888 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:30.307809 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:30.439182 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Instance destroyed successfully. Jan 26 19:13:30.440513 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lazy-loading 'resources' on Instance uuid 61de9322-0e97-42b2-990b-bd3d934cc215 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:13:30.528929 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c7d951b6-a6e9-40f1-ac90-d86d82cad5fb req-1de3abd1-99ef-4ed0-b85b-da1fcbf1c9a6 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received event network-vif-plugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:13:30.529176 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c7d951b6-a6e9-40f1-ac90-d86d82cad5fb req-1de3abd1-99ef-4ed0-b85b-da1fcbf1c9a6 service nova] Acquiring lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:30.532450 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c7d951b6-a6e9-40f1-ac90-d86d82cad5fb req-1de3abd1-99ef-4ed0-b85b-da1fcbf1c9a6 service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:30.532658 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c7d951b6-a6e9-40f1-ac90-d86d82cad5fb req-1de3abd1-99ef-4ed0-b85b-da1fcbf1c9a6 service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.003s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:30.532872 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c7d951b6-a6e9-40f1-ac90-d86d82cad5fb req-1de3abd1-99ef-4ed0-b85b-da1fcbf1c9a6 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] No waiting events found dispatching network-vif-plugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:13:30.533106 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-c7d951b6-a6e9-40f1-ac90-d86d82cad5fb req-1de3abd1-99ef-4ed0-b85b-da1fcbf1c9a6 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received unexpected event network-vif-plugged-e3bacf6d-13be-48f5-8924-a141832f639b for instance with vm_state active and task_state deleting. Jan 26 19:13:30.533290 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c7d951b6-a6e9-40f1-ac90-d86d82cad5fb req-1de3abd1-99ef-4ed0-b85b-da1fcbf1c9a6 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received event network-vif-plugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:13:30.533555 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c7d951b6-a6e9-40f1-ac90-d86d82cad5fb req-1de3abd1-99ef-4ed0-b85b-da1fcbf1c9a6 service nova] Acquiring lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:30.533711 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c7d951b6-a6e9-40f1-ac90-d86d82cad5fb req-1de3abd1-99ef-4ed0-b85b-da1fcbf1c9a6 service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:30.533906 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c7d951b6-a6e9-40f1-ac90-d86d82cad5fb req-1de3abd1-99ef-4ed0-b85b-da1fcbf1c9a6 service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:30.534084 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c7d951b6-a6e9-40f1-ac90-d86d82cad5fb req-1de3abd1-99ef-4ed0-b85b-da1fcbf1c9a6 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] No waiting events found dispatching network-vif-plugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:13:30.534260 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-c7d951b6-a6e9-40f1-ac90-d86d82cad5fb req-1de3abd1-99ef-4ed0-b85b-da1fcbf1c9a6 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received unexpected event network-vif-plugged-e3bacf6d-13be-48f5-8924-a141832f639b for instance with vm_state active and task_state deleting. Jan 26 19:13:30.534439 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c7d951b6-a6e9-40f1-ac90-d86d82cad5fb req-1de3abd1-99ef-4ed0-b85b-da1fcbf1c9a6 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received event network-vif-unplugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:13:30.534648 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c7d951b6-a6e9-40f1-ac90-d86d82cad5fb req-1de3abd1-99ef-4ed0-b85b-da1fcbf1c9a6 service nova] Acquiring lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:30.534867 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c7d951b6-a6e9-40f1-ac90-d86d82cad5fb req-1de3abd1-99ef-4ed0-b85b-da1fcbf1c9a6 service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:30.535042 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c7d951b6-a6e9-40f1-ac90-d86d82cad5fb req-1de3abd1-99ef-4ed0-b85b-da1fcbf1c9a6 service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:30.535212 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c7d951b6-a6e9-40f1-ac90-d86d82cad5fb req-1de3abd1-99ef-4ed0-b85b-da1fcbf1c9a6 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] No waiting events found dispatching network-vif-unplugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:13:30.535396 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c7d951b6-a6e9-40f1-ac90-d86d82cad5fb req-1de3abd1-99ef-4ed0-b85b-da1fcbf1c9a6 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received event network-vif-unplugged-e3bacf6d-13be-48f5-8924-a141832f639b for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:13:30.892099 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:13:30.907202 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:30.943906 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueTestJSON-server-1988772364',display_name='tempest-ServerRescueTestJSON-server-1988772364',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverrescuetestjson-server-1988772364',id=90,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:13:24Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='d5f9f30bee4144fcb8816ddc9af5c936',ramdisk_id='',reservation_id='r-i83e051u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueTestJSON-1540688849',owner_user_name='tempest-ServerRescueTestJSON-1540688849-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:13:28Z,user_data=None,user_id='d38980e1b13a4e598718de5500d63c87',uuid=61de9322-0e97-42b2-990b-bd3d934cc215,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3bacf6d-13be-48f5-8924-a141832f639b", "address": "fa:16:3e:83:cd:a1", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bacf6d-13", "ovs_interfaceid": "e3bacf6d-13be-48f5-8924-a141832f639b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:13:30.944112 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Converting VIF {"id": "e3bacf6d-13be-48f5-8924-a141832f639b", "address": "fa:16:3e:83:cd:a1", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bacf6d-13", "ovs_interfaceid": "e3bacf6d-13be-48f5-8924-a141832f639b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:13:30.944739 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:cd:a1,bridge_name='br-int',has_traffic_filtering=True,id=e3bacf6d-13be-48f5-8924-a141832f639b,network=Network(50d5f066-62ba-4607-97e7-f02ccc9e9e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bacf6d-13') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:13:30.945090 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:cd:a1,bridge_name='br-int',has_traffic_filtering=True,id=e3bacf6d-13be-48f5-8924-a141832f639b,network=Network(50d5f066-62ba-4607-97e7-f02ccc9e9e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bacf6d-13') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:13:30.949683 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:30.950048 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3bacf6d-13, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:13:30.955029 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:30.957180 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:13:30.957752 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:30.957954 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9e40476-bb67-4ff8-8ca8-80c1bf846a63) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:13:30.959540 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:30.962435 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:13:30.964249 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:cd:a1,bridge_name='br-int',has_traffic_filtering=True,id=e3bacf6d-13be-48f5-8924-a141832f639b,network=Network(50d5f066-62ba-4607-97e7-f02ccc9e9e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bacf6d-13') Jan 26 19:13:30.964503 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Deleting instance files /opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215_del Jan 26 19:13:30.965107 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Deletion of /opt/stack/data/nova/instances/61de9322-0e97-42b2-990b-bd3d934cc215_del complete Jan 26 19:13:31.473427 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Took 1.35 seconds to destroy the instance on the hypervisor. Jan 26 19:13:31.473427 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:13:31.473641 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:13:31.473641 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:13:31.473898 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:13:31.534239 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:13:31.896350 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-88bd745c-bd2d-4bb1-b70f-bbb1ae786e4b req-c1299b42-5104-4a09-9d7d-4b1a6cba86e2 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received event network-vif-deleted-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:13:31.896560 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-88bd745c-bd2d-4bb1-b70f-bbb1ae786e4b req-c1299b42-5104-4a09-9d7d-4b1a6cba86e2 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Neutron deleted interface e3bacf6d-13be-48f5-8924-a141832f639b; detaching it from the instance and deleting it from the info cache Jan 26 19:13:31.896737 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-88bd745c-bd2d-4bb1-b70f-bbb1ae786e4b req-c1299b42-5104-4a09-9d7d-4b1a6cba86e2 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:13:32.348151 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:13:32.401244 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-88bd745c-bd2d-4bb1-b70f-bbb1ae786e4b req-c1299b42-5104-4a09-9d7d-4b1a6cba86e2 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Detach interface failed, port_id=e3bacf6d-13be-48f5-8924-a141832f639b, reason: Instance 61de9322-0e97-42b2-990b-bd3d934cc215 could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:13:32.588484 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ba793b02-78fe-4973-ab26-86cd7b4bbd34 req-ba46046d-c641-4782-aebb-a891c9282fe9 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received event network-vif-unplugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:13:32.588484 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ba793b02-78fe-4973-ab26-86cd7b4bbd34 req-ba46046d-c641-4782-aebb-a891c9282fe9 service nova] Acquiring lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:32.588871 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ba793b02-78fe-4973-ab26-86cd7b4bbd34 req-ba46046d-c641-4782-aebb-a891c9282fe9 service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:32.588871 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ba793b02-78fe-4973-ab26-86cd7b4bbd34 req-ba46046d-c641-4782-aebb-a891c9282fe9 service nova] Lock "61de9322-0e97-42b2-990b-bd3d934cc215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:32.590020 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ba793b02-78fe-4973-ab26-86cd7b4bbd34 req-ba46046d-c641-4782-aebb-a891c9282fe9 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] No waiting events found dispatching network-vif-unplugged-e3bacf6d-13be-48f5-8924-a141832f639b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:13:32.590020 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ba793b02-78fe-4973-ab26-86cd7b4bbd34 req-ba46046d-c641-4782-aebb-a891c9282fe9 service nova] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Received event network-vif-unplugged-e3bacf6d-13be-48f5-8924-a141832f639b for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:13:32.852015 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Took 1.38 seconds to deallocate network for instance. Jan 26 19:13:32.952948 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:33.156014 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:33.361113 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:33.361725 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:33.487467 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:13:33.991639 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:13:34.497185 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.136s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:34.535506 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Deleted allocations for instance 61de9322-0e97-42b2-990b-bd3d934cc215 Jan 26 19:13:35.349161 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:13:35.349540 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] VM Stopped (Lifecycle Event) Jan 26 19:13:35.545127 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-efaaba27-9776-4ade-82ec-d8711b61073e tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "61de9322-0e97-42b2-990b-bd3d934cc215" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 5.934s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:35.852683 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-60feeb1b-8972-4585-81c1-d6614d832788 None None] [instance: 295123b2-57e9-4b0d-af2d-70b35167f85e] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:13:35.870139 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "d262fe4c-575d-4eb7-a180-467686ddeec9" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:35.870760 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:35.870760 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:35.871137 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:35.871137 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:35.873126 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Terminating instance Jan 26 19:13:35.961899 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:36.377435 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:13:36.468951 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:36.469699 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:36.487953 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:36.495572 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:36.605477 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:36.616657 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-8c245e7c-6206-4ac3-9cb5-b0f2104c6fb7 req-a9651e81-7366-4079-9da9-8880531ecd2d service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Received event network-vif-unplugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:13:36.616814 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-8c245e7c-6206-4ac3-9cb5-b0f2104c6fb7 req-a9651e81-7366-4079-9da9-8880531ecd2d service nova] Acquiring lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:36.616994 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-8c245e7c-6206-4ac3-9cb5-b0f2104c6fb7 req-a9651e81-7366-4079-9da9-8880531ecd2d service nova] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:36.617192 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-8c245e7c-6206-4ac3-9cb5-b0f2104c6fb7 req-a9651e81-7366-4079-9da9-8880531ecd2d service nova] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:36.617339 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-8c245e7c-6206-4ac3-9cb5-b0f2104c6fb7 req-a9651e81-7366-4079-9da9-8880531ecd2d service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] No waiting events found dispatching network-vif-unplugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:13:36.620384 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-8c245e7c-6206-4ac3-9cb5-b0f2104c6fb7 req-a9651e81-7366-4079-9da9-8880531ecd2d service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Received event network-vif-unplugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:13:36.665787 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Instance destroyed successfully. Jan 26 19:13:36.665787 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lazy-loading 'resources' on Instance uuid d262fe4c-575d-4eb7-a180-467686ddeec9 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:13:37.170050 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:12:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueTestJSON-server-2031478745',display_name='tempest-ServerRescueTestJSON-server-2031478745',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverrescuetestjson-server-2031478745',id=89,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:12:58Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='d5f9f30bee4144fcb8816ddc9af5c936',ramdisk_id='',reservation_id='r-thd4ri3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueTestJSON-1540688849',owner_user_name='tempest-ServerRescueTestJSON-1540688849-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:12:58Z,user_data=None,user_id='d38980e1b13a4e598718de5500d63c87',uuid=d262fe4c-575d-4eb7-a180-467686ddeec9,vcpu_model=,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "address": "fa:16:3e:51:29:69", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6d4cd-90", "ovs_interfaceid": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:13:37.171569 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Converting VIF {"id": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "address": "fa:16:3e:51:29:69", "network": {"id": "50d5f066-62ba-4607-97e7-f02ccc9e9e7d", "bridge": "br-int", "label": "tempest-ServerRescueTestJSON-1607741291-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "d5f9f30bee4144fcb8816ddc9af5c936", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6d4cd-90", "ovs_interfaceid": "fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:13:37.174897 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:29:69,bridge_name='br-int',has_traffic_filtering=True,id=fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a,network=Network(50d5f066-62ba-4607-97e7-f02ccc9e9e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd6d4cd-90') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:13:37.175364 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:29:69,bridge_name='br-int',has_traffic_filtering=True,id=fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a,network=Network(50d5f066-62ba-4607-97e7-f02ccc9e9e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd6d4cd-90') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:13:37.178484 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:37.178821 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfdd6d4cd-90, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:13:37.182881 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:37.186671 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:37.187995 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:37.188752 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea6c9815-abae-4eb3-9713-df234f99b4fe) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:13:37.190794 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:37.192196 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:37.195901 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:29:69,bridge_name='br-int',has_traffic_filtering=True,id=fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a,network=Network(50d5f066-62ba-4607-97e7-f02ccc9e9e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd6d4cd-90') Jan 26 19:13:37.196267 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Deleting instance files /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9_del Jan 26 19:13:37.197190 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Deletion of /opt/stack/data/nova/instances/d262fe4c-575d-4eb7-a180-467686ddeec9_del complete Jan 26 19:13:37.713585 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Took 1.33 seconds to destroy the instance on the hypervisor. Jan 26 19:13:37.713585 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:13:37.713585 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:13:37.713585 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:13:37.713585 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:13:37.795221 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:13:38.622545 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:13:38.656009 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7ff76143-37a7-4328-a284-5be37a3cf5f5 req-be6b02e9-555a-455d-8750-20e4b7dc7400 service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Received event network-vif-unplugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:13:38.656009 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7ff76143-37a7-4328-a284-5be37a3cf5f5 req-be6b02e9-555a-455d-8750-20e4b7dc7400 service nova] Acquiring lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:38.656009 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7ff76143-37a7-4328-a284-5be37a3cf5f5 req-be6b02e9-555a-455d-8750-20e4b7dc7400 service nova] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:38.656256 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7ff76143-37a7-4328-a284-5be37a3cf5f5 req-be6b02e9-555a-455d-8750-20e4b7dc7400 service nova] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:38.656556 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7ff76143-37a7-4328-a284-5be37a3cf5f5 req-be6b02e9-555a-455d-8750-20e4b7dc7400 service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] No waiting events found dispatching network-vif-unplugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:13:38.656838 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7ff76143-37a7-4328-a284-5be37a3cf5f5 req-be6b02e9-555a-455d-8750-20e4b7dc7400 service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Received event network-vif-unplugged-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:13:38.657095 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7ff76143-37a7-4328-a284-5be37a3cf5f5 req-be6b02e9-555a-455d-8750-20e4b7dc7400 service nova] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Received event network-vif-deleted-fdd6d4cd-9072-4ec2-a6a4-f6c8a4e6fe9a {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:13:39.126575 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Took 1.41 seconds to deallocate network for instance. Jan 26 19:13:39.634256 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:39.634256 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:39.722706 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:13:40.227414 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:13:40.738198 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.102s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:40.795120 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Deleted allocations for instance d262fe4c-575d-4eb7-a180-467686ddeec9 Jan 26 19:13:41.802815 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4a02fca2-1490-46b6-bb98-5acf177a039a tempest-ServerRescueTestJSON-1540688849 tempest-ServerRescueTestJSON-1540688849-project-member] Lock "d262fe4c-575d-4eb7-a180-467686ddeec9" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 5.932s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:42.091954 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:42.190976 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:44.633555 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:45.431081 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:13:45.431300 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] VM Stopped (Lifecycle Event) Jan 26 19:13:45.935821 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-949c6554-0ba7-4824-b00e-0411a8ae7b0b None None] [instance: 61de9322-0e97-42b2-990b-bd3d934cc215] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:13:47.192714 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:48.856613 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:51.184850 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:51.660271 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:13:51.660398 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] VM Stopped (Lifecycle Event) Jan 26 19:13:52.170101 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c3707fe3-a155-4497-b7bc-f0d5c74998be None None] [instance: d262fe4c-575d-4eb7-a180-467686ddeec9] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:13:52.196019 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:52.997153 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:53.122777 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Acquiring lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:53.122777 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:53.624896 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:13:54.180693 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:54.180976 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:54.183702 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:13:54.183879 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Claim successful on node np0005596550.novalocal Jan 26 19:13:55.269402 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:13:55.773003 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:13:56.278739 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.097s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:56.279506 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:13:56.787728 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:13:56.788047 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:13:56.788539 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:13:56.788913 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:13:56.871308 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fec351cde2343778e5d6a5a58abb5d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f6adb053994dc097c2cc8b5cabedfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:13:57.197618 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:57.303459 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:13:57.445789 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Successfully created port: e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:13:57.807206 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:13:57.997996 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:13:58.380985 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Successfully updated port: e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:13:58.434933 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7fa1f614-3514-4a15-b374-dbb19474331b req-8b1c9134-221c-43ef-a398-792ab32e9524 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Received event network-changed-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:13:58.435112 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7fa1f614-3514-4a15-b374-dbb19474331b req-8b1c9134-221c-43ef-a398-792ab32e9524 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Refreshing instance network info cache due to event network-changed-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:13:58.435339 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7fa1f614-3514-4a15-b374-dbb19474331b req-8b1c9134-221c-43ef-a398-792ab32e9524 service nova] Acquiring lock "refresh_cache-10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:13:58.435513 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7fa1f614-3514-4a15-b374-dbb19474331b req-8b1c9134-221c-43ef-a398-792ab32e9524 service nova] Acquired lock "refresh_cache-10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:13:58.435713 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-7fa1f614-3514-4a15-b374-dbb19474331b req-8b1c9134-221c-43ef-a398-792ab32e9524 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Refreshing network info cache for port e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:13:58.820850 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:13:58.821890 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:13:58.822185 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Creating image(s) Jan 26 19:13:58.822642 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Acquiring lock "/opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:58.822886 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lock "/opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:58.823463 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lock "/opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:58.824141 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:13:58.828081 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:13:58.829328 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:58.885698 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Acquiring lock "refresh_cache-10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:13:58.917810 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.088s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:58.918124 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:58.918478 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:58.919042 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:13:58.921964 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:13:58.922259 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:58.973667 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-7fa1f614-3514-4a15-b374-dbb19474331b req-8b1c9134-221c-43ef-a398-792ab32e9524 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:13:59.040191 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.118s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:59.040567 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:59.062030 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-7fa1f614-3514-4a15-b374-dbb19474331b req-8b1c9134-221c-43ef-a398-792ab32e9524 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:13:59.097876 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk 1073741824" returned: 0 in 0.057s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:59.098254 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.180s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:59.098589 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:59.191506 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.093s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:59.191932 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Checking if we can resize image /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:13:59.192198 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:59.237262 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-7fa1f614-3514-4a15-b374-dbb19474331b req-8b1c9134-221c-43ef-a398-792ab32e9524 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:13:59.278869 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:59.279088 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Cannot resize image /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:13:59.279373 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:13:59.279551 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Ensure instance console log exists: /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:13:59.279966 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:13:59.280223 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:13:59.280418 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:13:59.740789 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7fa1f614-3514-4a15-b374-dbb19474331b req-8b1c9134-221c-43ef-a398-792ab32e9524 service nova] Releasing lock "refresh_cache-10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:13:59.741317 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Acquired lock "refresh_cache-10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:13:59.741549 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:14:00.308911 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:14:00.536852 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:00.685120 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Updating instance_info_cache with network_info: [{"id": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "address": "fa:16:3e:32:97:1e", "network": {"id": "a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4", "bridge": "br-int", "label": "tempest-ServerRescueTestJSONUnderV235-584554207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "a3f6adb053994dc097c2cc8b5cabedfe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape90d6adc-45", "ovs_interfaceid": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:14:01.188283 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Releasing lock "refresh_cache-10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:14:01.188670 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Instance network_info: |[{"id": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "address": "fa:16:3e:32:97:1e", "network": {"id": "a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4", "bridge": "br-int", "label": "tempest-ServerRescueTestJSONUnderV235-584554207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "a3f6adb053994dc097c2cc8b5cabedfe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape90d6adc-45", "ovs_interfaceid": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:14:01.191163 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Start _get_guest_xml network_info=[{"id": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "address": "fa:16:3e:32:97:1e", "network": {"id": "a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4", "bridge": "br-int", "label": "tempest-ServerRescueTestJSONUnderV235-584554207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "a3f6adb053994dc097c2cc8b5cabedfe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape90d6adc-45", "ovs_interfaceid": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:14:01.195216 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:14:01.196345 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueTestJSONUnderV235-server-1761318581', uuid='10bb18ca-98c5-4234-9e1f-c6cc0315ecc1'), owner=OwnerMeta(userid='5fec351cde2343778e5d6a5a58abb5d5', username='tempest-ServerRescueTestJSONUnderV235-1824798674-project-member', projectid='a3f6adb053994dc097c2cc8b5cabedfe', projectname='tempest-ServerRescueTestJSONUnderV235-1824798674'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "address": "fa:16:3e:32:97:1e", "network": {"id": "a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4", "bridge": "br-int", "label": "tempest-ServerRescueTestJSONUnderV235-584554207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "a3f6adb053994dc097c2cc8b5cabedfe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape90d6adc-45", "ovs_interfaceid": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472841.195988) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:14:01.198812 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:14:01.198812 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:14:01.200122 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:14:01.200727 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:14:01.201517 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:14:01.201932 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:14:01.202155 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:14:01.202321 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:14:01.202529 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:14:01.202720 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:14:01.202917 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:14:01.203164 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:14:01.203342 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:14:01.203530 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:14:01.203717 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:14:01.203926 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:14:01.208852 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:13:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueTestJSONUnderV235-server-1761318581',display_name='tempest-ServerRescueTestJSONUnderV235-server-1761318581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverrescuetestjsonunderv235-server-1761318581',id=91,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3f6adb053994dc097c2cc8b5cabedfe',ramdisk_id='',reservation_id='r-qdog3an6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueTestJSONUnderV235-1824798674',owner_user_name='tempest-ServerRescueTestJSONUnderV235-1824798674-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:13:57Z,user_data=None,user_id='5fec351cde2343778e5d6a5a58abb5d5',uuid=10bb18ca-98c5-4234-9e1f-c6cc0315ecc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "address": "fa:16:3e:32:97:1e", "network": {"id": "a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4", "bridge": "br-int", "label": "tempest-ServerRescueTestJSONUnderV235-584554207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "a3f6adb053994dc097c2cc8b5cabedfe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape90d6adc-45", "ovs_interfaceid": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:14:01.208852 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Converting VIF {"id": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "address": "fa:16:3e:32:97:1e", "network": {"id": "a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4", "bridge": "br-int", "label": "tempest-ServerRescueTestJSONUnderV235-584554207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "a3f6adb053994dc097c2cc8b5cabedfe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape90d6adc-45", "ovs_interfaceid": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:14:01.209435 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=e90d6adc-45e6-4bde-a7d0-d5e0aabdb581,network=Network(a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape90d6adc-45') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:14:01.210117 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lazy-loading 'pci_devices' on Instance uuid 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] End _get_guest_xml xml= Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1 Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: instance-0000005b Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: tempest-ServerRescueTestJSONUnderV235-server-1761318581 Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:14:01 Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: tempest-ServerRescueTestJSONUnderV235-1824798674-project-member Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: tempest-ServerRescueTestJSONUnderV235-1824798674 Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1 Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1 Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:14:01.714347 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Preparing to wait for external event network-vif-plugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:14:01.716184 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Acquiring lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:01.716184 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:01.716184 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:01.716184 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:13:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueTestJSONUnderV235-server-1761318581',display_name='tempest-ServerRescueTestJSONUnderV235-server-1761318581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverrescuetestjsonunderv235-server-1761318581',id=91,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3f6adb053994dc097c2cc8b5cabedfe',ramdisk_id='',reservation_id='r-qdog3an6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueTestJSONUnderV235-1824798674',owner_user_name='tempest-ServerRescueTestJSONUnderV235-1824798674-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:13:57Z,user_data=None,user_id='5fec351cde2343778e5d6a5a58abb5d5',uuid=10bb18ca-98c5-4234-9e1f-c6cc0315ecc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "address": "fa:16:3e:32:97:1e", "network": {"id": "a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4", "bridge": "br-int", "label": "tempest-ServerRescueTestJSONUnderV235-584554207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "a3f6adb053994dc097c2cc8b5cabedfe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape90d6adc-45", "ovs_interfaceid": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:14:01.716390 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Converting VIF {"id": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "address": "fa:16:3e:32:97:1e", "network": {"id": "a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4", "bridge": "br-int", "label": "tempest-ServerRescueTestJSONUnderV235-584554207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "a3f6adb053994dc097c2cc8b5cabedfe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape90d6adc-45", "ovs_interfaceid": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:14:01.716390 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=e90d6adc-45e6-4bde-a7d0-d5e0aabdb581,network=Network(a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape90d6adc-45') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:14:01.716794 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=e90d6adc-45e6-4bde-a7d0-d5e0aabdb581,network=Network(a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape90d6adc-45') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:14:01.716936 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:01.717210 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:14:01.717500 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:14:01.718027 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:01.718207 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '74ac939e-715c-545c-b97e-f7b1ca2ddbe8', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:14:01.719081 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:01.721082 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:14:01.721951 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:01.724604 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:01.724815 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape90d6adc-45, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:14:01.725118 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape90d6adc-45, col_values=(('qos', UUID('906bcc21-9c3d-4960-9880-39bcbde386b7')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:14:01.725287 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape90d6adc-45, col_values=(('external_ids', {'iface-id': 'e90d6adc-45e6-4bde-a7d0-d5e0aabdb581', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:97:1e', 'vm-uuid': '10bb18ca-98c5-4234-9e1f-c6cc0315ecc1'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:14:01.726125 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:01.729356 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:14:01.733724 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:01.734625 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=e90d6adc-45e6-4bde-a7d0-d5e0aabdb581,network=Network(a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape90d6adc-45') Jan 26 19:14:03.259807 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:14:03.259807 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:14:03.259807 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] No VIF found with MAC fa:16:3e:32:97:1e, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:14:03.259807 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Using config drive Jan 26 19:14:03.765746 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:03.875755 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Creating config drive at /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk.config Jan 26 19:14:03.879087 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpk2jkny_0 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:14:04.005130 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpk2jkny_0" returned: 0 in 0.126s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:14:04.075026 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:04.075026 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:04.075026 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:04.092778 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:04.097065 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:04.286944 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:14:04.287351 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] VM Started (Lifecycle Event) Jan 26 19:14:04.319192 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3ddeee38-08e3-4398-9c08-a8f3de0113c7 req-edd77c2f-6991-4eb0-99e8-117718d51b61 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Received event network-vif-plugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:14:04.319569 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3ddeee38-08e3-4398-9c08-a8f3de0113c7 req-edd77c2f-6991-4eb0-99e8-117718d51b61 service nova] Acquiring lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:04.319812 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3ddeee38-08e3-4398-9c08-a8f3de0113c7 req-edd77c2f-6991-4eb0-99e8-117718d51b61 service nova] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:04.319996 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3ddeee38-08e3-4398-9c08-a8f3de0113c7 req-edd77c2f-6991-4eb0-99e8-117718d51b61 service nova] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:04.320163 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3ddeee38-08e3-4398-9c08-a8f3de0113c7 req-edd77c2f-6991-4eb0-99e8-117718d51b61 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Processing event network-vif-plugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:14:04.321092 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:14:04.325949 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:14:04.328703 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Instance spawned successfully. Jan 26 19:14:04.329033 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:14:04.397469 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:04.401323 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:04.407064 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:04.407608 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:04.411429 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:04.791948 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:14:04.797913 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:14:04.836864 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:14:04.837203 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:14:04.837534 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:14:04.837842 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:14:04.838226 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:14:04.838621 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:14:05.302176 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:14:05.302604 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:14:05.302604 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] VM Paused (Lifecycle Event) Jan 26 19:14:05.345930 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Took 6.52 seconds to spawn the instance on the hypervisor. Jan 26 19:14:05.346141 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:14:05.806038 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:14:05.809900 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:14:05.810082 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] VM Resumed (Lifecycle Event) Jan 26 19:14:05.858555 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Took 11.73 seconds to build instance. Jan 26 19:14:06.313580 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:14:06.319387 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:14:06.362330 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3dc87bae-d214-450f-882f-c2e853b228ce tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 13.239s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:06.366258 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-cf8d7709-6d5e-4f86-94f7-67d007196194 req-3d7cc0a0-24f3-4933-9755-ef83df2f49b3 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Received event network-vif-plugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:14:06.366258 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-cf8d7709-6d5e-4f86-94f7-67d007196194 req-3d7cc0a0-24f3-4933-9755-ef83df2f49b3 service nova] Acquiring lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:06.366258 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-cf8d7709-6d5e-4f86-94f7-67d007196194 req-3d7cc0a0-24f3-4933-9755-ef83df2f49b3 service nova] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:06.366258 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-cf8d7709-6d5e-4f86-94f7-67d007196194 req-3d7cc0a0-24f3-4933-9755-ef83df2f49b3 service nova] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:06.366258 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-cf8d7709-6d5e-4f86-94f7-67d007196194 req-3d7cc0a0-24f3-4933-9755-ef83df2f49b3 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] No waiting events found dispatching network-vif-plugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:14:06.366258 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-cf8d7709-6d5e-4f86-94f7-67d007196194 req-3d7cc0a0-24f3-4933-9755-ef83df2f49b3 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Received unexpected event network-vif-plugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 for instance with vm_state active and task_state None. Jan 26 19:14:06.728164 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:07.538518 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Rescuing Jan 26 19:14:07.539113 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Acquiring lock "refresh_cache-10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:14:07.539113 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Acquired lock "refresh_cache-10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:14:07.539165 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:14:08.000383 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:08.042477 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:08.504785 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:08.813285 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Updating instance_info_cache with network_info: [{"id": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "address": "fa:16:3e:32:97:1e", "network": {"id": "a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4", "bridge": "br-int", "label": "tempest-ServerRescueTestJSONUnderV235-584554207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "a3f6adb053994dc097c2cc8b5cabedfe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape90d6adc-45", "ovs_interfaceid": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:14:09.318797 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Releasing lock "refresh_cache-10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:14:10.928792 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:10.949012 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:10.959800 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:11.095727 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-2bd535c7-dcc0-44ca-9d33-41054d657f4d req-896a0310-b15d-4807-855f-cdfbbb2c6997 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Received event network-vif-unplugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:14:11.095727 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2bd535c7-dcc0-44ca-9d33-41054d657f4d req-896a0310-b15d-4807-855f-cdfbbb2c6997 service nova] Acquiring lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:11.095727 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2bd535c7-dcc0-44ca-9d33-41054d657f4d req-896a0310-b15d-4807-855f-cdfbbb2c6997 service nova] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:11.095727 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2bd535c7-dcc0-44ca-9d33-41054d657f4d req-896a0310-b15d-4807-855f-cdfbbb2c6997 service nova] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:11.095727 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-2bd535c7-dcc0-44ca-9d33-41054d657f4d req-896a0310-b15d-4807-855f-cdfbbb2c6997 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] No waiting events found dispatching network-vif-unplugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:14:11.095727 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-2bd535c7-dcc0-44ca-9d33-41054d657f4d req-896a0310-b15d-4807-855f-cdfbbb2c6997 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Received unexpected event network-vif-unplugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 for instance with vm_state active and task_state rescuing. Jan 26 19:14:11.222569 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Instance destroyed successfully. Jan 26 19:14:11.222928 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lazy-loading 'numa_topology' on Instance uuid 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:14:11.729229 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Attempting rescue Jan 26 19:14:11.729505 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=189076) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4599}} Jan 26 19:14:11.729711 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:11.731995 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Instance directory exists: not creating {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5157}} Jan 26 19:14:11.732172 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Creating image(s) Jan 26 19:14:11.732713 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Acquiring lock "/opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:11.732916 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lock "/opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:11.733386 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lock "/opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:11.733591 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lazy-loading 'trusted_certs' on Instance uuid 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:14:12.236468 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Object Instance<10bb18ca-98c5-4234-9e1f-c6cc0315ecc1> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:14:12.237235 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:14:12.241547 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:14:12.242706 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:12.243115 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:12.243463 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:14:12.247791 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:14:12.248264 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:14:12.326092 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.077s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:14:12.326552 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk.rescue {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:14:12.539628 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk.rescue" returned: 0 in 0.212s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:14:12.540682 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.297s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:12.541693 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lazy-loading 'migration_context' on Instance uuid 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:14:13.047351 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Object Instance<10bb18ca-98c5-4234-9e1f-c6cc0315ecc1> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:14:13.047884 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:14:13.048992 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Start _get_guest_xml network_info=[{"id": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "address": "fa:16:3e:32:97:1e", "network": {"id": "a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4", "bridge": "br-int", "label": "tempest-ServerRescueTestJSONUnderV235-584554207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueTestJSONUnderV235-584554207-network", "vif_mac": "fa:16:3e:32:97:1e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "a3f6adb053994dc097c2cc8b5cabedfe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape90d6adc-45", "ovs_interfaceid": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue={'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:14:13.049399 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lazy-loading 'resources' on Instance uuid 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:14:13.137531 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4dbdf810-e364-43b6-b7b8-50a0fab689d0 req-ae66912b-8d9c-41d6-9a38-ce3449373bae service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Received event network-vif-unplugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:14:13.139166 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4dbdf810-e364-43b6-b7b8-50a0fab689d0 req-ae66912b-8d9c-41d6-9a38-ce3449373bae service nova] Acquiring lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:13.139611 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4dbdf810-e364-43b6-b7b8-50a0fab689d0 req-ae66912b-8d9c-41d6-9a38-ce3449373bae service nova] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:13.139947 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4dbdf810-e364-43b6-b7b8-50a0fab689d0 req-ae66912b-8d9c-41d6-9a38-ce3449373bae service nova] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:13.140406 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4dbdf810-e364-43b6-b7b8-50a0fab689d0 req-ae66912b-8d9c-41d6-9a38-ce3449373bae service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] No waiting events found dispatching network-vif-unplugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:14:13.142993 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-4dbdf810-e364-43b6-b7b8-50a0fab689d0 req-ae66912b-8d9c-41d6-9a38-ce3449373bae service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Received unexpected event network-vif-unplugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 for instance with vm_state active and task_state rescuing. Jan 26 19:14:13.554932 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Object Instance<10bb18ca-98c5-4234-9e1f-c6cc0315ecc1> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:14:13.559628 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:14:13.560828 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueTestJSONUnderV235-server-1761318581', uuid='10bb18ca-98c5-4234-9e1f-c6cc0315ecc1'), owner=OwnerMeta(userid='5fec351cde2343778e5d6a5a58abb5d5', username='tempest-ServerRescueTestJSONUnderV235-1824798674-project-member', projectid='a3f6adb053994dc097c2cc8b5cabedfe', projectname='tempest-ServerRescueTestJSONUnderV235-1824798674'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "address": "fa:16:3e:32:97:1e", "network": {"id": "a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4", "bridge": "br-int", "label": "tempest-ServerRescueTestJSONUnderV235-584554207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueTestJSONUnderV235-584554207-network", "vif_mac": "fa:16:3e:32:97:1e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "a3f6adb053994dc097c2cc8b5cabedfe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape90d6adc-45", "ovs_interfaceid": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472853.560398) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:14:13.562354 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:14:13.563087 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:14:13.565746 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:14:13.566457 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:14:13.568623 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:14:13.569386 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:14:13.569784 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:14:13.570310 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:14:13.570637 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:14:13.570966 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:14:13.571228 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:14:13.571587 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:14:13.571933 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:14:13.572231 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:14:13.572504 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:14:13.573015 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:14:13.573408 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lazy-loading 'vcpu_model' on Instance uuid 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:14:13.647961 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "62dba4cc-3bec-479a-9c7a-f656b5b91386" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:13.648232 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "62dba4cc-3bec-479a-9c7a-f656b5b91386" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:14.077333 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Object Instance<10bb18ca-98c5-4234-9e1f-c6cc0315ecc1> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:14:14.081803 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:13:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueTestJSONUnderV235-server-1761318581',display_name='tempest-ServerRescueTestJSONUnderV235-server-1761318581',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverrescuetestjsonunderv235-server-1761318581',id=91,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:14:05Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='a3f6adb053994dc097c2cc8b5cabedfe',ramdisk_id='',reservation_id='r-qdog3an6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueTestJSONUnderV235-1824798674',owner_user_name='tempest-ServerRescueTestJSONUnderV235-1824798674-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:14:05Z,user_data=None,user_id='5fec351cde2343778e5d6a5a58abb5d5',uuid=10bb18ca-98c5-4234-9e1f-c6cc0315ecc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "address": "fa:16:3e:32:97:1e", "network": {"id": "a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4", "bridge": "br-int", "label": "tempest-ServerRescueTestJSONUnderV235-584554207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueTestJSONUnderV235-584554207-network", "vif_mac": "fa:16:3e:32:97:1e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "a3f6adb053994dc097c2cc8b5cabedfe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape90d6adc-45", "ovs_interfaceid": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:14:14.082076 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Converting VIF {"id": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "address": "fa:16:3e:32:97:1e", "network": {"id": "a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4", "bridge": "br-int", "label": "tempest-ServerRescueTestJSONUnderV235-584554207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueTestJSONUnderV235-584554207-network", "vif_mac": "fa:16:3e:32:97:1e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "a3f6adb053994dc097c2cc8b5cabedfe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape90d6adc-45", "ovs_interfaceid": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:14:14.082813 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=e90d6adc-45e6-4bde-a7d0-d5e0aabdb581,network=Network(a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape90d6adc-45') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:14:14.083466 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lazy-loading 'pci_devices' on Instance uuid 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:14:14.150488 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:14:14.586574 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Object Instance<10bb18ca-98c5-4234-9e1f-c6cc0315ecc1> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] End _get_guest_xml xml= Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1 Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: instance-0000005b Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: tempest-ServerRescueTestJSONUnderV235-server-1761318581 Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:14:13 Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: ide Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: pc Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: tempest-ServerRescueTestJSONUnderV235-1824798674-project-member Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: tempest-ServerRescueTestJSONUnderV235-1824798674 Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1 Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1 Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:14.587906 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:14:14.593629 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Instance destroyed successfully. Jan 26 19:14:14.689007 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:14.689239 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:14.692834 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:14:14.693001 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Claim successful on node np0005596550.novalocal Jan 26 19:14:15.819360 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:14:16.116557 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:14:16.116684 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] No BDM found with device name vdb, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:14:16.116884 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:14:16.117073 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] No VIF found with MAC fa:16:3e:32:97:1e, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:14:16.117700 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Using config drive Jan 26 19:14:16.323462 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:14:16.623799 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lazy-loading 'ec2_ids' on Instance uuid 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:14:16.731823 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:14:16.731823 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:16.731940 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:14:16.732156 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:14:16.732545 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:14:16.732864 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:16.831306 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.142s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:16.831888 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:14:17.126071 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Object Instance<10bb18ca-98c5-4234-9e1f-c6cc0315ecc1> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:14:17.126213 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lazy-loading 'keypairs' on Instance uuid 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:14:17.339830 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:14:17.339998 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:14:17.340376 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:17.340952 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:17.417423 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6cbe3740f6c4303bbf3e5d5c92677db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261cb1c98c954302ba86efa2ceee43f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:14:17.629840 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Object Instance<10bb18ca-98c5-4234-9e1f-c6cc0315ecc1> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:14:17.636280 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:17.767169 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Creating config drive at /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk.config.rescue Jan 26 19:14:17.770477 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpa9w20tkc {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:14:17.846309 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:14:17.878165 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Successfully created port: 337720a2-10c1-4f42-ab4f-23bb29c7f627 {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:14:17.893820 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpa9w20tkc" returned: 0 in 0.123s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:14:17.954938 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:17.961120 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:17.970483 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:18.128971 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-208bc2a0-bc1c-4801-8223-b7bf4fba384c req-c0d0a38b-974a-4a80-8302-e2e424c0efe6 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Received event network-vif-plugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:14:18.128971 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-208bc2a0-bc1c-4801-8223-b7bf4fba384c req-c0d0a38b-974a-4a80-8302-e2e424c0efe6 service nova] Acquiring lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:18.128971 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-208bc2a0-bc1c-4801-8223-b7bf4fba384c req-c0d0a38b-974a-4a80-8302-e2e424c0efe6 service nova] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:18.129243 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-208bc2a0-bc1c-4801-8223-b7bf4fba384c req-c0d0a38b-974a-4a80-8302-e2e424c0efe6 service nova] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:18.129243 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-208bc2a0-bc1c-4801-8223-b7bf4fba384c req-c0d0a38b-974a-4a80-8302-e2e424c0efe6 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] No waiting events found dispatching network-vif-plugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:14:18.129371 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-208bc2a0-bc1c-4801-8223-b7bf4fba384c req-c0d0a38b-974a-4a80-8302-e2e424c0efe6 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Received unexpected event network-vif-plugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 for instance with vm_state active and task_state rescuing. Jan 26 19:14:18.167425 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1 due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:14:18.167723 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:14:18.167932 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] VM Resumed (Lifecycle Event) Jan 26 19:14:18.181394 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-6ba705cc-798c-42b2-85d8-44935132f893 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:14:18.212444 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:18.215803 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:18.220820 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:18.228119 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:18.355881 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:14:18.382894 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Successfully updated port: 337720a2-10c1-4f42-ab4f-23bb29c7f627 {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:14:18.408754 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e10e89ee-7e16-4bce-8458-91df082030af req-aec951fe-c918-487f-9483-9fbcaaeb2b3b service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Received event network-changed-337720a2-10c1-4f42-ab4f-23bb29c7f627 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:14:18.408754 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e10e89ee-7e16-4bce-8458-91df082030af req-aec951fe-c918-487f-9483-9fbcaaeb2b3b service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Refreshing instance network info cache due to event network-changed-337720a2-10c1-4f42-ab4f-23bb29c7f627. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:14:18.408754 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e10e89ee-7e16-4bce-8458-91df082030af req-aec951fe-c918-487f-9483-9fbcaaeb2b3b service nova] Acquiring lock "refresh_cache-62dba4cc-3bec-479a-9c7a-f656b5b91386" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:14:18.408754 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e10e89ee-7e16-4bce-8458-91df082030af req-aec951fe-c918-487f-9483-9fbcaaeb2b3b service nova] Acquired lock "refresh_cache-62dba4cc-3bec-479a-9c7a-f656b5b91386" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:14:18.408754 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-e10e89ee-7e16-4bce-8458-91df082030af req-aec951fe-c918-487f-9483-9fbcaaeb2b3b service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Refreshing network info cache for port 337720a2-10c1-4f42-ab4f-23bb29c7f627 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:14:18.677601 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:14:18.680764 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:14:18.885692 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "refresh_cache-62dba4cc-3bec-479a-9c7a-f656b5b91386" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:14:18.896682 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:14:18.896682 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Cleaning up deleted instances {{(pid=189076) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11960}} Jan 26 19:14:18.911671 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-e10e89ee-7e16-4bce-8458-91df082030af req-aec951fe-c918-487f-9483-9fbcaaeb2b3b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:18.972561 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-e10e89ee-7e16-4bce-8458-91df082030af req-aec951fe-c918-487f-9483-9fbcaaeb2b3b service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:14:19.185243 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:14:19.185607 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] VM Started (Lifecycle Event) Jan 26 19:14:19.246153 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-e10e89ee-7e16-4bce-8458-91df082030af req-aec951fe-c918-487f-9483-9fbcaaeb2b3b service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:14:19.365654 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:14:19.367795 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:14:19.367795 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Creating image(s) Jan 26 19:14:19.367795 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "/opt/stack/data/nova/instances/62dba4cc-3bec-479a-9c7a-f656b5b91386/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:19.368000 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "/opt/stack/data/nova/instances/62dba4cc-3bec-479a-9c7a-f656b5b91386/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:19.368670 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "/opt/stack/data/nova/instances/62dba4cc-3bec-479a-9c7a-f656b5b91386/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:19.369456 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:14:19.373394 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:14:19.374727 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:14:19.398789 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] There are 0 instances to clean {{(pid=189076) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11969}} Jan 26 19:14:19.466292 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.091s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:14:19.466607 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:19.467052 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:19.467487 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:14:19.470434 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:14:19.470721 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:14:19.558034 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.087s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:14:19.558406 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/62dba4cc-3bec-479a-9c7a-f656b5b91386/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:14:19.610243 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/62dba4cc-3bec-479a-9c7a-f656b5b91386/disk 1073741824" returned: 0 in 0.051s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:14:19.610243 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.143s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:19.610243 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:14:19.689559 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:14:19.693418 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:14:19.718948 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.109s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:14:19.719580 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62dba4cc-3bec-479a-9c7a-f656b5b91386/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:14:19.719848 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dba4cc-3bec-479a-9c7a-f656b5b91386/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:14:19.749864 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e10e89ee-7e16-4bce-8458-91df082030af req-aec951fe-c918-487f-9483-9fbcaaeb2b3b service nova] Releasing lock "refresh_cache-62dba4cc-3bec-479a-9c7a-f656b5b91386" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:14:19.750298 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquired lock "refresh_cache-62dba4cc-3bec-479a-9c7a-f656b5b91386" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:14:19.750726 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:14:19.792399 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dba4cc-3bec-479a-9c7a-f656b5b91386/disk --force-share --output=json" returned: 0 in 0.072s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:14:19.792579 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Cannot resize image /opt/stack/data/nova/instances/62dba4cc-3bec-479a-9c7a-f656b5b91386/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:14:19.792896 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:14:19.793088 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Ensure instance console log exists: /opt/stack/data/nova/instances/62dba4cc-3bec-479a-9c7a-f656b5b91386/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:14:19.793617 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:19.795941 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:19.796815 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:20.175974 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-50792d4a-1700-4b76-91fd-164f2974d1fe req-b9916e4e-f09f-4049-9874-847373023eac service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Received event network-vif-plugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:14:20.176293 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-50792d4a-1700-4b76-91fd-164f2974d1fe req-b9916e4e-f09f-4049-9874-847373023eac service nova] Acquiring lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:20.176608 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-50792d4a-1700-4b76-91fd-164f2974d1fe req-b9916e4e-f09f-4049-9874-847373023eac service nova] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:20.176825 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-50792d4a-1700-4b76-91fd-164f2974d1fe req-b9916e4e-f09f-4049-9874-847373023eac service nova] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:20.177020 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-50792d4a-1700-4b76-91fd-164f2974d1fe req-b9916e4e-f09f-4049-9874-847373023eac service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] No waiting events found dispatching network-vif-plugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:14:20.177165 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-50792d4a-1700-4b76-91fd-164f2974d1fe req-b9916e4e-f09f-4049-9874-847373023eac service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Received unexpected event network-vif-plugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 for instance with vm_state rescued and task_state None. Jan 26 19:14:20.303215 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:14:20.398315 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:14:20.398546 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:14:20.412231 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:20.511152 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Updating instance_info_cache with network_info: [{"id": "337720a2-10c1-4f42-ab4f-23bb29c7f627", "address": "fa:16:3e:eb:a5:8e", "network": {"id": "94b85e06-699e-4d2b-a361-6a62d99d858f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1614914474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261cb1c98c954302ba86efa2ceee43f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap337720a2-10", "ovs_interfaceid": "337720a2-10c1-4f42-ab4f-23bb29c7f627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:14:20.905864 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:20.906281 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:20.906629 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:20.907267 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:14:21.016071 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Releasing lock "refresh_cache-62dba4cc-3bec-479a-9c7a-f656b5b91386" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:14:21.016478 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Instance network_info: |[{"id": "337720a2-10c1-4f42-ab4f-23bb29c7f627", "address": "fa:16:3e:eb:a5:8e", "network": {"id": "94b85e06-699e-4d2b-a361-6a62d99d858f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1614914474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261cb1c98c954302ba86efa2ceee43f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap337720a2-10", "ovs_interfaceid": "337720a2-10c1-4f42-ab4f-23bb29c7f627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:14:21.018512 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Start _get_guest_xml network_info=[{"id": "337720a2-10c1-4f42-ab4f-23bb29c7f627", "address": "fa:16:3e:eb:a5:8e", "network": {"id": "94b85e06-699e-4d2b-a361-6a62d99d858f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1614914474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261cb1c98c954302ba86efa2ceee43f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap337720a2-10", "ovs_interfaceid": "337720a2-10c1-4f42-ab4f-23bb29c7f627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:14:21.021428 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:14:21.022538 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-1088358399', uuid='62dba4cc-3bec-479a-9c7a-f656b5b91386'), owner=OwnerMeta(userid='e6cbe3740f6c4303bbf3e5d5c92677db', username='tempest-VolumesBackupsTest-97611117-project-member', projectid='261cb1c98c954302ba86efa2ceee43f2', projectname='tempest-VolumesBackupsTest-97611117'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "337720a2-10c1-4f42-ab4f-23bb29c7f627", "address": "fa:16:3e:eb:a5:8e", "network": {"id": "94b85e06-699e-4d2b-a361-6a62d99d858f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1614914474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261cb1c98c954302ba86efa2ceee43f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap337720a2-10", "ovs_interfaceid": "337720a2-10c1-4f42-ab4f-23bb29c7f627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472861.0222178) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:14:21.025309 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:14:21.025754 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:14:21.026929 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:14:21.027266 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:14:21.028146 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:14:21.028545 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:14:21.028711 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:14:21.029272 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:14:21.029376 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:14:21.029525 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:14:21.029703 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:14:21.029827 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:14:21.029984 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:14:21.030100 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:14:21.030251 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:14:21.030369 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:14:21.034437 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:14:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1088358399',display_name='tempest-VolumesBackupsTest-instance-1088358399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-volumesbackupstest-instance-1088358399',id=92,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOl0KIECtw/lnzJQ7soiCWj5snZsufKRgMYqFq/buu5oOilMG2vAkjBybaPMVU1Vgq8sPBnV7yCucLSBYDy/Z2wEN1HGEWTImDBA0r9R9l2hj6Mpq/neqRvUNssXu77lg==',key_name='tempest-keypair-519673318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='261cb1c98c954302ba86efa2ceee43f2',ramdisk_id='',reservation_id='r-5e0lzoym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-97611117',owner_user_name='tempest-VolumesBackupsTest-97611117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:14:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6cbe3740f6c4303bbf3e5d5c92677db',uuid=62dba4cc-3bec-479a-9c7a-f656b5b91386,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "337720a2-10c1-4f42-ab4f-23bb29c7f627", "address": "fa:16:3e:eb:a5:8e", "network": {"id": "94b85e06-699e-4d2b-a361-6a62d99d858f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1614914474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261cb1c98c954302ba86efa2ceee43f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap337720a2-10", "ovs_interfaceid": "337720a2-10c1-4f42-ab4f-23bb29c7f627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:14:21.034649 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Converting VIF {"id": "337720a2-10c1-4f42-ab4f-23bb29c7f627", "address": "fa:16:3e:eb:a5:8e", "network": {"id": "94b85e06-699e-4d2b-a361-6a62d99d858f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1614914474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261cb1c98c954302ba86efa2ceee43f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap337720a2-10", "ovs_interfaceid": "337720a2-10c1-4f42-ab4f-23bb29c7f627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:14:21.035201 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:a5:8e,bridge_name='br-int',has_traffic_filtering=True,id=337720a2-10c1-4f42-ab4f-23bb29c7f627,network=Network(94b85e06-699e-4d2b-a361-6a62d99d858f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap337720a2-10') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:14:21.035744 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lazy-loading 'pci_devices' on Instance uuid 62dba4cc-3bec-479a-9c7a-f656b5b91386 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] End _get_guest_xml xml= Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: 62dba4cc-3bec-479a-9c7a-f656b5b91386 Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: instance-0000005c Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: tempest-VolumesBackupsTest-instance-1088358399 Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:14:21 Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: tempest-VolumesBackupsTest-97611117-project-member Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: tempest-VolumesBackupsTest-97611117 Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: 62dba4cc-3bec-479a-9c7a-f656b5b91386 Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: 62dba4cc-3bec-479a-9c7a-f656b5b91386 Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:21.543178 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:14:21.544697 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Preparing to wait for external event network-vif-plugged-337720a2-10c1-4f42-ab4f-23bb29c7f627 {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:14:21.544697 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "62dba4cc-3bec-479a-9c7a-f656b5b91386-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:21.544697 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "62dba4cc-3bec-479a-9c7a-f656b5b91386-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:21.544697 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "62dba4cc-3bec-479a-9c7a-f656b5b91386-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:21.544697 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:14:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1088358399',display_name='tempest-VolumesBackupsTest-instance-1088358399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-volumesbackupstest-instance-1088358399',id=92,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOl0KIECtw/lnzJQ7soiCWj5snZsufKRgMYqFq/buu5oOilMG2vAkjBybaPMVU1Vgq8sPBnV7yCucLSBYDy/Z2wEN1HGEWTImDBA0r9R9l2hj6Mpq/neqRvUNssXu77lg==',key_name='tempest-keypair-519673318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='261cb1c98c954302ba86efa2ceee43f2',ramdisk_id='',reservation_id='r-5e0lzoym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-97611117',owner_user_name='tempest-VolumesBackupsTest-97611117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:14:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6cbe3740f6c4303bbf3e5d5c92677db',uuid=62dba4cc-3bec-479a-9c7a-f656b5b91386,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "337720a2-10c1-4f42-ab4f-23bb29c7f627", "address": "fa:16:3e:eb:a5:8e", "network": {"id": "94b85e06-699e-4d2b-a361-6a62d99d858f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1614914474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261cb1c98c954302ba86efa2ceee43f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap337720a2-10", "ovs_interfaceid": "337720a2-10c1-4f42-ab4f-23bb29c7f627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:14:21.544944 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Converting VIF {"id": "337720a2-10c1-4f42-ab4f-23bb29c7f627", "address": "fa:16:3e:eb:a5:8e", "network": {"id": "94b85e06-699e-4d2b-a361-6a62d99d858f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1614914474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261cb1c98c954302ba86efa2ceee43f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap337720a2-10", "ovs_interfaceid": "337720a2-10c1-4f42-ab4f-23bb29c7f627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:14:21.545369 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:a5:8e,bridge_name='br-int',has_traffic_filtering=True,id=337720a2-10c1-4f42-ab4f-23bb29c7f627,network=Network(94b85e06-699e-4d2b-a361-6a62d99d858f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap337720a2-10') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:14:21.545609 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:a5:8e,bridge_name='br-int',has_traffic_filtering=True,id=337720a2-10c1-4f42-ab4f-23bb29c7f627,network=Network(94b85e06-699e-4d2b-a361-6a62d99d858f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap337720a2-10') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:14:21.546023 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:21.546309 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:14:21.546557 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:14:21.547163 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:21.547365 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c98c984-d76f-5b7d-b15c-72d5539e6c67', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:14:21.549052 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:21.550164 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:21.552023 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:21.552203 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap337720a2-10, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:14:21.552491 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap337720a2-10, col_values=(('qos', UUID('909620d4-64f6-4143-b0c3-3b3aa5132632')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:14:21.552682 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap337720a2-10, col_values=(('external_ids', {'iface-id': '337720a2-10c1-4f42-ab4f-23bb29c7f627', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:a5:8e', 'vm-uuid': '62dba4cc-3bec-479a-9c7a-f656b5b91386'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:14:21.553942 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:21.558018 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:14:21.563842 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:21.563842 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:a5:8e,bridge_name='br-int',has_traffic_filtering=True,id=337720a2-10c1-4f42-ab4f-23bb29c7f627,network=Network(94b85e06-699e-4d2b-a361-6a62d99d858f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap337720a2-10') Jan 26 19:14:21.943543 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk.rescue --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:14:22.022451 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk.rescue --force-share --output=json" returned: 0 in 0.079s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:14:22.022899 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk.rescue --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:14:22.105989 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk.rescue --force-share --output=json" returned: 0 in 0.082s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:14:22.105989 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:14:22.188948 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:14:22.189380 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:14:22.227376 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-dba50478-70fd-4943-be38-21d70e37b452 req-b712a34b-46f4-4e85-87be-7a5865ae9e94 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Received event network-changed-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:14:22.227562 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-dba50478-70fd-4943-be38-21d70e37b452 req-b712a34b-46f4-4e85-87be-7a5865ae9e94 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Refreshing instance network info cache due to event network-changed-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:14:22.228094 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-dba50478-70fd-4943-be38-21d70e37b452 req-b712a34b-46f4-4e85-87be-7a5865ae9e94 service nova] Acquiring lock "refresh_cache-10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:14:22.228257 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-dba50478-70fd-4943-be38-21d70e37b452 req-b712a34b-46f4-4e85-87be-7a5865ae9e94 service nova] Acquired lock "refresh_cache-10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:14:22.228406 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-dba50478-70fd-4943-be38-21d70e37b452 req-b712a34b-46f4-4e85-87be-7a5865ae9e94 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Refreshing network info cache for port e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:14:22.274133 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:14:22.343210 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b5b91e40-0bd0-4990-b7d7-44b261c1b60f req-c1c43122-aad9-4fcd-828f-02e75e998980 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Received event network-changed-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:14:22.344734 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b5b91e40-0bd0-4990-b7d7-44b261c1b60f req-c1c43122-aad9-4fcd-828f-02e75e998980 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Refreshing instance network info cache due to event network-changed-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:14:22.344734 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b5b91e40-0bd0-4990-b7d7-44b261c1b60f req-c1c43122-aad9-4fcd-828f-02e75e998980 service nova] Acquiring lock "refresh_cache-10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:14:22.418566 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:14:22.419514 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:14:22.442720 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.023s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:14:22.443024 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=7766MB free_disk=373.05587005615234GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:14:22.443156 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:22.443393 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:22.730994 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-dba50478-70fd-4943-be38-21d70e37b452 req-b712a34b-46f4-4e85-87be-7a5865ae9e94 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:22.998123 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-dba50478-70fd-4943-be38-21d70e37b452 req-b712a34b-46f4-4e85-87be-7a5865ae9e94 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:23.012858 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:23.089860 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:14:23.090040 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:14:23.090190 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] No VIF found with MAC fa:16:3e:eb:a5:8e, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:14:23.090756 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Using config drive Jan 26 19:14:23.131240 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-dba50478-70fd-4943-be38-21d70e37b452 req-b712a34b-46f4-4e85-87be-7a5865ae9e94 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Updated VIF entry in instance network info cache for port e90d6adc-45e6-4bde-a7d0-d5e0aabdb581. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:14:23.131611 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-dba50478-70fd-4943-be38-21d70e37b452 req-b712a34b-46f4-4e85-87be-7a5865ae9e94 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Updating instance_info_cache with network_info: [{"id": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "address": "fa:16:3e:32:97:1e", "network": {"id": "a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4", "bridge": "br-int", "label": "tempest-ServerRescueTestJSONUnderV235-584554207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "a3f6adb053994dc097c2cc8b5cabedfe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape90d6adc-45", "ovs_interfaceid": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:14:23.601212 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:23.626943 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:14:23.627230 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 62dba4cc-3bec-479a-9c7a-f656b5b91386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:14:23.627470 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 2 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:14:23.627662 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=896MB phys_disk=399GB used_disk=2GB total_vcpus=8 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:14:22 up 42 min, 13 users, load average: 3.99, 4.71, 4.19\n', 'num_instances': '2', 'num_vm_rescued': '1', 'num_task_None': '1', 'num_os_type_None': '2', 'num_proj_a3f6adb053994dc097c2cc8b5cabedfe': '1', 'io_workload': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_261cb1c98c954302ba86efa2ceee43f2': '1'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:14:23.648834 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-dba50478-70fd-4943-be38-21d70e37b452 req-b712a34b-46f4-4e85-87be-7a5865ae9e94 service nova] Releasing lock "refresh_cache-10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:14:23.648834 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-dba50478-70fd-4943-be38-21d70e37b452 req-b712a34b-46f4-4e85-87be-7a5865ae9e94 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Received event network-changed-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:14:23.648834 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-dba50478-70fd-4943-be38-21d70e37b452 req-b712a34b-46f4-4e85-87be-7a5865ae9e94 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Refreshing instance network info cache due to event network-changed-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:14:23.648834 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-dba50478-70fd-4943-be38-21d70e37b452 req-b712a34b-46f4-4e85-87be-7a5865ae9e94 service nova] Acquiring lock "refresh_cache-10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:14:23.648834 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-dba50478-70fd-4943-be38-21d70e37b452 req-b712a34b-46f4-4e85-87be-7a5865ae9e94 service nova] Acquired lock "refresh_cache-10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:14:23.648834 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-dba50478-70fd-4943-be38-21d70e37b452 req-b712a34b-46f4-4e85-87be-7a5865ae9e94 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Refreshing network info cache for port e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:14:23.756024 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Creating config drive at /opt/stack/data/nova/instances/62dba4cc-3bec-479a-9c7a-f656b5b91386/disk.config Jan 26 19:14:23.761330 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/62dba4cc-3bec-479a-9c7a-f656b5b91386/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpxtf1naqm {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:14:23.782979 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:14:23.893171 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/62dba4cc-3bec-479a-9c7a-f656b5b91386/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpxtf1naqm" returned: 0 in 0.131s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:14:23.958295 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:23.981899 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:24.149388 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:14:24.149628 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] VM Started (Lifecycle Event) Jan 26 19:14:24.157254 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-dba50478-70fd-4943-be38-21d70e37b452 req-b712a34b-46f4-4e85-87be-7a5865ae9e94 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:24.255071 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:24.258480 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:24.262374 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:24.267967 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:24.284149 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-397d0b7b-766e-4c30-8152-7e60719679f9 req-0d45b38d-b9f4-46b6-91f4-34a18b5b37ab service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Received event network-changed-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:14:24.284149 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-397d0b7b-766e-4c30-8152-7e60719679f9 req-0d45b38d-b9f4-46b6-91f4-34a18b5b37ab service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Refreshing instance network info cache due to event network-changed-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:14:24.284149 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-397d0b7b-766e-4c30-8152-7e60719679f9 req-0d45b38d-b9f4-46b6-91f4-34a18b5b37ab service nova] Acquiring lock "refresh_cache-10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:14:24.305172 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:14:24.389026 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ea97cc20-5404-4d99-a2eb-1dd065d715d9 req-c6cb7884-9a4d-4398-8359-7905121f40ba service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Received event network-vif-plugged-337720a2-10c1-4f42-ab4f-23bb29c7f627 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:14:24.389264 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ea97cc20-5404-4d99-a2eb-1dd065d715d9 req-c6cb7884-9a4d-4398-8359-7905121f40ba service nova] Acquiring lock "62dba4cc-3bec-479a-9c7a-f656b5b91386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:24.389726 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ea97cc20-5404-4d99-a2eb-1dd065d715d9 req-c6cb7884-9a4d-4398-8359-7905121f40ba service nova] Lock "62dba4cc-3bec-479a-9c7a-f656b5b91386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:24.389840 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ea97cc20-5404-4d99-a2eb-1dd065d715d9 req-c6cb7884-9a4d-4398-8359-7905121f40ba service nova] Lock "62dba4cc-3bec-479a-9c7a-f656b5b91386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:24.389995 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ea97cc20-5404-4d99-a2eb-1dd065d715d9 req-c6cb7884-9a4d-4398-8359-7905121f40ba service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Processing event network-vif-plugged-337720a2-10c1-4f42-ab4f-23bb29c7f627 {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:14:24.390700 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:14:24.395793 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:14:24.405389 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Instance spawned successfully. Jan 26 19:14:24.405724 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:14:24.510380 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-dba50478-70fd-4943-be38-21d70e37b452 req-b712a34b-46f4-4e85-87be-7a5865ae9e94 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:24.612929 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-dba50478-70fd-4943-be38-21d70e37b452 req-b712a34b-46f4-4e85-87be-7a5865ae9e94 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Updated VIF entry in instance network info cache for port e90d6adc-45e6-4bde-a7d0-d5e0aabdb581. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:14:24.614123 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-dba50478-70fd-4943-be38-21d70e37b452 req-b712a34b-46f4-4e85-87be-7a5865ae9e94 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Updating instance_info_cache with network_info: [{"id": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "address": "fa:16:3e:32:97:1e", "network": {"id": "a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4", "bridge": "br-int", "label": "tempest-ServerRescueTestJSONUnderV235-584554207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "a3f6adb053994dc097c2cc8b5cabedfe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape90d6adc-45", "ovs_interfaceid": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:14:24.656268 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:14:24.661896 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:14:24.815850 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:14:24.816221 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.373s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:24.816324 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:14:24.915678 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:14:24.915902 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:14:24.916287 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:14:24.916644 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:14:24.917202 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:14:24.917563 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:14:25.119926 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-dba50478-70fd-4943-be38-21d70e37b452 req-b712a34b-46f4-4e85-87be-7a5865ae9e94 service nova] Releasing lock "refresh_cache-10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:14:25.120389 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b5b91e40-0bd0-4990-b7d7-44b261c1b60f req-c1c43122-aad9-4fcd-828f-02e75e998980 service nova] Acquired lock "refresh_cache-10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:14:25.120615 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-b5b91e40-0bd0-4990-b7d7-44b261c1b60f req-c1c43122-aad9-4fcd-828f-02e75e998980 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Refreshing network info cache for port e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:14:25.165789 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:14:25.165986 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:14:25.166117 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] VM Paused (Lifecycle Event) Jan 26 19:14:25.425565 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Took 6.06 seconds to spawn the instance on the hypervisor. Jan 26 19:14:25.426345 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:14:25.481015 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Acquiring lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:25.481327 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:25.481565 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Acquiring lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:25.481796 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:25.482011 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:25.486571 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Terminating instance Jan 26 19:14:25.624301 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-b5b91e40-0bd0-4990-b7d7-44b261c1b60f req-c1c43122-aad9-4fcd-828f-02e75e998980 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:25.670629 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:14:25.674026 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:14:25.674198 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] VM Resumed (Lifecycle Event) Jan 26 19:14:25.815561 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:14:25.815831 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:14:25.816036 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:14:25.910720 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-b5b91e40-0bd0-4990-b7d7-44b261c1b60f req-c1c43122-aad9-4fcd-828f-02e75e998980 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:25.941130 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Took 11.29 seconds to build instance. Jan 26 19:14:25.994288 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:14:26.066502 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-b5b91e40-0bd0-4990-b7d7-44b261c1b60f req-c1c43122-aad9-4fcd-828f-02e75e998980 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Updated VIF entry in instance network info cache for port e90d6adc-45e6-4bde-a7d0-d5e0aabdb581. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:14:26.066813 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-b5b91e40-0bd0-4990-b7d7-44b261c1b60f req-c1c43122-aad9-4fcd-828f-02e75e998980 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Updating instance_info_cache with network_info: [{"id": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "address": "fa:16:3e:32:97:1e", "network": {"id": "a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4", "bridge": "br-int", "label": "tempest-ServerRescueTestJSONUnderV235-584554207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "a3f6adb053994dc097c2cc8b5cabedfe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape90d6adc-45", "ovs_interfaceid": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:14:26.082918 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:26.087251 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:26.102302 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:26.113992 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:26.178139 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:14:26.185442 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:14:26.321073 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Instance destroyed successfully. Jan 26 19:14:26.321541 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lazy-loading 'resources' on Instance uuid 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:14:26.365272 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e0f1c638-cc94-4ead-bb09-2dadff998f7d req-7597f514-177a-44f3-8276-1d786b05e0e2 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Received event network-vif-unplugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:14:26.365272 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e0f1c638-cc94-4ead-bb09-2dadff998f7d req-7597f514-177a-44f3-8276-1d786b05e0e2 service nova] Acquiring lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:26.365272 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e0f1c638-cc94-4ead-bb09-2dadff998f7d req-7597f514-177a-44f3-8276-1d786b05e0e2 service nova] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:26.365426 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e0f1c638-cc94-4ead-bb09-2dadff998f7d req-7597f514-177a-44f3-8276-1d786b05e0e2 service nova] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:26.365519 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e0f1c638-cc94-4ead-bb09-2dadff998f7d req-7597f514-177a-44f3-8276-1d786b05e0e2 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] No waiting events found dispatching network-vif-unplugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:14:26.365717 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e0f1c638-cc94-4ead-bb09-2dadff998f7d req-7597f514-177a-44f3-8276-1d786b05e0e2 service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Received event network-vif-unplugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:14:26.445075 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b7b2534b-03a4-4cac-99a7-bdfa8a4785d5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "62dba4cc-3bec-479a-9c7a-f656b5b91386" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 12.796s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:26.535778 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ba9c0812-d8e3-47f1-a31c-a5867ffdadf0 req-ad79feee-8edf-4548-b934-f6d18906807d service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Received event network-vif-plugged-337720a2-10c1-4f42-ab4f-23bb29c7f627 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:14:26.535778 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ba9c0812-d8e3-47f1-a31c-a5867ffdadf0 req-ad79feee-8edf-4548-b934-f6d18906807d service nova] Acquiring lock "62dba4cc-3bec-479a-9c7a-f656b5b91386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:26.535778 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ba9c0812-d8e3-47f1-a31c-a5867ffdadf0 req-ad79feee-8edf-4548-b934-f6d18906807d service nova] Lock "62dba4cc-3bec-479a-9c7a-f656b5b91386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:26.535778 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ba9c0812-d8e3-47f1-a31c-a5867ffdadf0 req-ad79feee-8edf-4548-b934-f6d18906807d service nova] Lock "62dba4cc-3bec-479a-9c7a-f656b5b91386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:26.535778 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ba9c0812-d8e3-47f1-a31c-a5867ffdadf0 req-ad79feee-8edf-4548-b934-f6d18906807d service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] No waiting events found dispatching network-vif-plugged-337720a2-10c1-4f42-ab4f-23bb29c7f627 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:14:26.535778 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-ba9c0812-d8e3-47f1-a31c-a5867ffdadf0 req-ad79feee-8edf-4548-b934-f6d18906807d service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Received unexpected event network-vif-plugged-337720a2-10c1-4f42-ab4f-23bb29c7f627 for instance with vm_state active and task_state None. Jan 26 19:14:26.554993 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:26.570025 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b5b91e40-0bd0-4990-b7d7-44b261c1b60f req-c1c43122-aad9-4fcd-828f-02e75e998980 service nova] Releasing lock "refresh_cache-10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:14:26.570728 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-397d0b7b-766e-4c30-8152-7e60719679f9 req-0d45b38d-b9f4-46b6-91f4-34a18b5b37ab service nova] Acquired lock "refresh_cache-10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:14:26.570969 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-397d0b7b-766e-4c30-8152-7e60719679f9 req-0d45b38d-b9f4-46b6-91f4-34a18b5b37ab service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Refreshing network info cache for port e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:14:26.829639 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:13:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueTestJSONUnderV235-server-1761318581',display_name='tempest-ServerRescueTestJSONUnderV235-server-1761318581',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverrescuetestjsonunderv235-server-1761318581',id=91,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:14:18Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='a3f6adb053994dc097c2cc8b5cabedfe',ramdisk_id='',reservation_id='r-qdog3an6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueTestJSONUnderV235-1824798674',owner_user_name='tempest-ServerRescueTestJSONUnderV235-1824798674-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:14:18Z,user_data=None,user_id='5fec351cde2343778e5d6a5a58abb5d5',uuid=10bb18ca-98c5-4234-9e1f-c6cc0315ecc1,vcpu_model=,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "address": "fa:16:3e:32:97:1e", "network": {"id": "a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4", "bridge": "br-int", "label": "tempest-ServerRescueTestJSONUnderV235-584554207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "a3f6adb053994dc097c2cc8b5cabedfe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape90d6adc-45", "ovs_interfaceid": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:14:26.829639 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Converting VIF {"id": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "address": "fa:16:3e:32:97:1e", "network": {"id": "a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4", "bridge": "br-int", "label": "tempest-ServerRescueTestJSONUnderV235-584554207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "a3f6adb053994dc097c2cc8b5cabedfe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape90d6adc-45", "ovs_interfaceid": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:14:26.829639 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=e90d6adc-45e6-4bde-a7d0-d5e0aabdb581,network=Network(a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape90d6adc-45') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:14:26.830192 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=e90d6adc-45e6-4bde-a7d0-d5e0aabdb581,network=Network(a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape90d6adc-45') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:14:26.831177 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:26.831549 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape90d6adc-45, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:14:26.832589 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:26.834152 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:26.835981 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:26.835981 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=906bcc21-9c3d-4960-9880-39bcbde386b7) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:14:26.836165 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:26.836912 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:26.838689 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=e90d6adc-45e6-4bde-a7d0-d5e0aabdb581,network=Network(a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape90d6adc-45') Jan 26 19:14:26.839070 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Deleting instance files /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1_del Jan 26 19:14:26.839851 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Deletion of /opt/stack/data/nova/instances/10bb18ca-98c5-4234-9e1f-c6cc0315ecc1_del complete Jan 26 19:14:26.895539 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:14:26.896059 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:14:27.079787 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-397d0b7b-766e-4c30-8152-7e60719679f9 req-0d45b38d-b9f4-46b6-91f4-34a18b5b37ab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:27.351088 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Took 1.35 seconds to destroy the instance on the hypervisor. Jan 26 19:14:27.351088 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:14:27.351088 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:14:27.351088 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:14:27.351088 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:27.467527 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:27.787015 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-397d0b7b-766e-4c30-8152-7e60719679f9 req-0d45b38d-b9f4-46b6-91f4-34a18b5b37ab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:27.890582 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-397d0b7b-766e-4c30-8152-7e60719679f9 req-0d45b38d-b9f4-46b6-91f4-34a18b5b37ab service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Updated VIF entry in instance network info cache for port e90d6adc-45e6-4bde-a7d0-d5e0aabdb581. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:14:27.890582 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-397d0b7b-766e-4c30-8152-7e60719679f9 req-0d45b38d-b9f4-46b6-91f4-34a18b5b37ab service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Updating instance_info_cache with network_info: [{"id": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "address": "fa:16:3e:32:97:1e", "network": {"id": "a2c4a92b-6661-44c5-85a7-d6d52a4a4bd4", "bridge": "br-int", "label": "tempest-ServerRescueTestJSONUnderV235-584554207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": false}}], "meta": {"injected": false, "tenant_id": "a3f6adb053994dc097c2cc8b5cabedfe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape90d6adc-45", "ovs_interfaceid": "e90d6adc-45e6-4bde-a7d0-d5e0aabdb581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:14:27.896525 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:14:28.007982 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:28.226628 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:14:28.392563 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-397d0b7b-766e-4c30-8152-7e60719679f9 req-0d45b38d-b9f4-46b6-91f4-34a18b5b37ab service nova] Releasing lock "refresh_cache-10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:14:28.426195 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-85da367f-587d-450d-ae3a-014538f3fd7d req-ff831143-7ce1-414a-8134-29c3193b7c3d service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Received event network-vif-unplugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:14:28.426195 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-85da367f-587d-450d-ae3a-014538f3fd7d req-ff831143-7ce1-414a-8134-29c3193b7c3d service nova] Acquiring lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:28.426195 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-85da367f-587d-450d-ae3a-014538f3fd7d req-ff831143-7ce1-414a-8134-29c3193b7c3d service nova] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:28.426195 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-85da367f-587d-450d-ae3a-014538f3fd7d req-ff831143-7ce1-414a-8134-29c3193b7c3d service nova] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:28.426195 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-85da367f-587d-450d-ae3a-014538f3fd7d req-ff831143-7ce1-414a-8134-29c3193b7c3d service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] No waiting events found dispatching network-vif-unplugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:14:28.426195 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-85da367f-587d-450d-ae3a-014538f3fd7d req-ff831143-7ce1-414a-8134-29c3193b7c3d service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Received event network-vif-unplugged-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:14:28.426195 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-85da367f-587d-450d-ae3a-014538f3fd7d req-ff831143-7ce1-414a-8134-29c3193b7c3d service nova] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Received event network-vif-deleted-e90d6adc-45e6-4bde-a7d0-d5e0aabdb581 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:14:28.556812 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b42ecd90-1ec7-4291-a679-0bf0a92ed777 req-a3fa61e1-8422-4704-906c-6b875f42e2f6 service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Received event network-changed-337720a2-10c1-4f42-ab4f-23bb29c7f627 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:14:28.556812 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b42ecd90-1ec7-4291-a679-0bf0a92ed777 req-a3fa61e1-8422-4704-906c-6b875f42e2f6 service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Refreshing instance network info cache due to event network-changed-337720a2-10c1-4f42-ab4f-23bb29c7f627. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:14:28.556812 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b42ecd90-1ec7-4291-a679-0bf0a92ed777 req-a3fa61e1-8422-4704-906c-6b875f42e2f6 service nova] Acquiring lock "refresh_cache-62dba4cc-3bec-479a-9c7a-f656b5b91386" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:14:28.556812 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b42ecd90-1ec7-4291-a679-0bf0a92ed777 req-a3fa61e1-8422-4704-906c-6b875f42e2f6 service nova] Acquired lock "refresh_cache-62dba4cc-3bec-479a-9c7a-f656b5b91386" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:14:28.556812 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-b42ecd90-1ec7-4291-a679-0bf0a92ed777 req-a3fa61e1-8422-4704-906c-6b875f42e2f6 service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Refreshing network info cache for port 337720a2-10c1-4f42-ab4f-23bb29c7f627 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:14:28.730411 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Took 1.38 seconds to deallocate network for instance. Jan 26 19:14:28.892037 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:14:29.058869 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-b42ecd90-1ec7-4291-a679-0bf0a92ed777 req-a3fa61e1-8422-4704-906c-6b875f42e2f6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:29.237382 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:29.237382 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:29.284600 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Refreshing inventories for resource provider f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}} Jan 26 19:14:29.337833 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Updating ProviderTree inventory for provider f627156c-932e-4a32-97b3-315a994a2ac9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}} Jan 26 19:14:29.337833 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Updating inventory in ProviderTree for provider f627156c-932e-4a32-97b3-315a994a2ac9 with inventory: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jan 26 19:14:29.366982 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Refreshing aggregate associations for resource provider f627156c-932e-4a32-97b3-315a994a2ac9, aggregates: None {{(pid=189076) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}} Jan 26 19:14:29.432165 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Refreshing trait associations for resource provider f627156c-932e-4a32-97b3-315a994a2ac9, traits: COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_ADDRESS_SPACE_EMULATED,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOUND_MODEL_SB16,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_IGB,HW_ARCH_X86_64,COMPUTE_ARCH_X86_64,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_SECURITY_STATELESS_FIRMWARE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOUND_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOUND_MODEL_AC97,COMPUTE_SOUND_MODEL_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ADDRESS_SPACE_PASSTHROUGH {{(pid=189076) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}} Jan 26 19:14:29.464930 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-b42ecd90-1ec7-4291-a679-0bf0a92ed777 req-a3fa61e1-8422-4704-906c-6b875f42e2f6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:29.556352 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:14:29.582183 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-b42ecd90-1ec7-4291-a679-0bf0a92ed777 req-a3fa61e1-8422-4704-906c-6b875f42e2f6 service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Updated VIF entry in instance network info cache for port 337720a2-10c1-4f42-ab4f-23bb29c7f627. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:14:29.582183 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-b42ecd90-1ec7-4291-a679-0bf0a92ed777 req-a3fa61e1-8422-4704-906c-6b875f42e2f6 service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Updating instance_info_cache with network_info: [{"id": "337720a2-10c1-4f42-ab4f-23bb29c7f627", "address": "fa:16:3e:eb:a5:8e", "network": {"id": "94b85e06-699e-4d2b-a361-6a62d99d858f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1614914474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261cb1c98c954302ba86efa2ceee43f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap337720a2-10", "ovs_interfaceid": "337720a2-10c1-4f42-ab4f-23bb29c7f627", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:14:30.060905 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:14:30.087455 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b42ecd90-1ec7-4291-a679-0bf0a92ed777 req-a3fa61e1-8422-4704-906c-6b875f42e2f6 service nova] Releasing lock "refresh_cache-62dba4cc-3bec-479a-9c7a-f656b5b91386" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:14:30.567839 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.328s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:30.621913 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Deleted allocations for instance 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1 Jan 26 19:14:31.633589 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-862e306f-e865-4d5b-836f-ee1f5da6dbc9 tempest-ServerRescueTestJSONUnderV235-1824798674 tempest-ServerRescueTestJSONUnderV235-1824798674-project-member] Lock "10bb18ca-98c5-4234-9e1f-c6cc0315ecc1" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.151s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:31.836747 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:31.898184 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:14:31.898184 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Cleaning up deleted instances with incomplete migration {{(pid=189076) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11998}} Jan 26 19:14:33.009062 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:33.626804 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:36.839183 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:38.010535 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:38.748666 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:41.359206 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:41.688968 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:14:41.689095 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] VM Stopped (Lifecycle Event) Jan 26 19:14:41.841466 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:42.192532 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-f2f2824e-78ed-4ed7-b8b1-8a23b70073ec None None] [instance: 10bb18ca-98c5-4234-9e1f-c6cc0315ecc1] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:14:43.017831 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:43.072987 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:43.532070 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:43.532276 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:44.035271 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:14:44.578201 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:44.578621 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:44.584219 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:14:44.584653 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Claim successful on node np0005596550.novalocal Jan 26 19:14:45.716940 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:14:46.224884 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:14:46.727935 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.149s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:46.728321 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:14:46.891086 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:47.235860 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:14:47.236215 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:14:47.238963 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:47.238963 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:47.339797 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2724dd8bb624423083210013b9f090aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3d68b8b1459bbf07574e4b01f715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:14:47.758796 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:14:47.762390 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Successfully created port: eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:14:48.031317 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:48.281528 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Successfully updated port: eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:14:48.288701 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:14:48.317461 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c950f17e-7ff5-4fd5-a3c3-ee503dea91cb req-d2cb5c6d-46c9-47f9-aa02-a61e1fa71fb7 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received event network-changed-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:14:48.317461 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c950f17e-7ff5-4fd5-a3c3-ee503dea91cb req-d2cb5c6d-46c9-47f9-aa02-a61e1fa71fb7 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Refreshing instance network info cache due to event network-changed-eb474507-4ff1-42e7-ba50-0a3caae5255d. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:14:48.317461 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c950f17e-7ff5-4fd5-a3c3-ee503dea91cb req-d2cb5c6d-46c9-47f9-aa02-a61e1fa71fb7 service nova] Acquiring lock "refresh_cache-4b54d0fc-613e-4ce1-8ba9-54651f4079bc" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:14:48.317461 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c950f17e-7ff5-4fd5-a3c3-ee503dea91cb req-d2cb5c6d-46c9-47f9-aa02-a61e1fa71fb7 service nova] Acquired lock "refresh_cache-4b54d0fc-613e-4ce1-8ba9-54651f4079bc" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:14:48.317461 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-c950f17e-7ff5-4fd5-a3c3-ee503dea91cb req-d2cb5c6d-46c9-47f9-aa02-a61e1fa71fb7 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Refreshing network info cache for port eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:14:48.435871 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4cb29462-5b40-42cf-af85-95be809ca0df req-a8792797-3869-49e6-a6e6-afd53617ae60 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received event network-vif-unplugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:14:48.435871 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4cb29462-5b40-42cf-af85-95be809ca0df req-a8792797-3869-49e6-a6e6-afd53617ae60 service nova] Acquiring lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:48.435871 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4cb29462-5b40-42cf-af85-95be809ca0df req-a8792797-3869-49e6-a6e6-afd53617ae60 service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:48.435871 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4cb29462-5b40-42cf-af85-95be809ca0df req-a8792797-3869-49e6-a6e6-afd53617ae60 service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:48.435871 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4cb29462-5b40-42cf-af85-95be809ca0df req-a8792797-3869-49e6-a6e6-afd53617ae60 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] No waiting events found dispatching network-vif-unplugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:14:48.435871 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-4cb29462-5b40-42cf-af85-95be809ca0df req-a8792797-3869-49e6-a6e6-afd53617ae60 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received unexpected event network-vif-unplugged-eb474507-4ff1-42e7-ba50-0a3caae5255d for instance with vm_state building and task_state block_device_mapping. Jan 26 19:14:48.784060 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "refresh_cache-4b54d0fc-613e-4ce1-8ba9-54651f4079bc" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:14:48.820301 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-c950f17e-7ff5-4fd5-a3c3-ee503dea91cb req-d2cb5c6d-46c9-47f9-aa02-a61e1fa71fb7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:48.931249 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-c950f17e-7ff5-4fd5-a3c3-ee503dea91cb req-d2cb5c6d-46c9-47f9-aa02-a61e1fa71fb7 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:14:49.094354 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-c950f17e-7ff5-4fd5-a3c3-ee503dea91cb req-d2cb5c6d-46c9-47f9-aa02-a61e1fa71fb7 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:14:49.299125 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:14:49.300703 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:14:49.302391 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Creating image(s) Jan 26 19:14:49.303262 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:49.303481 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:49.304106 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:49.304599 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:14:49.307392 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:14:49.308520 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:14:49.376438 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.068s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:14:49.376827 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:49.377215 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:49.377610 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:14:49.380442 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:14:49.380787 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:14:49.466887 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.086s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:14:49.467243 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:14:49.597997 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c950f17e-7ff5-4fd5-a3c3-ee503dea91cb req-d2cb5c6d-46c9-47f9-aa02-a61e1fa71fb7 service nova] Releasing lock "refresh_cache-4b54d0fc-613e-4ce1-8ba9-54651f4079bc" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:14:49.598657 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquired lock "refresh_cache-4b54d0fc-613e-4ce1-8ba9-54651f4079bc" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:14:49.598875 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:14:50.188973 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:14:50.373303 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk 1073741824" returned: 0 in 0.906s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:14:50.373645 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.996s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:50.374235 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:14:50.466696 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:50.491171 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.116s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:14:50.492664 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:14:50.493160 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:14:50.586992 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:14:50.587648 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Cannot resize image /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:14:50.588319 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:14:50.588714 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Ensure instance console log exists: /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:14:50.591661 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:50.591984 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:50.592199 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:50.659575 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Updating instance_info_cache with network_info: [{"id": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "address": "fa:16:3e:ee:b3:6b", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb474507-4f", "ovs_interfaceid": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:14:51.162691 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Releasing lock "refresh_cache-4b54d0fc-613e-4ce1-8ba9-54651f4079bc" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:14:51.163063 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Instance network_info: |[{"id": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "address": "fa:16:3e:ee:b3:6b", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb474507-4f", "ovs_interfaceid": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:14:51.165019 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Start _get_guest_xml network_info=[{"id": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "address": "fa:16:3e:ee:b3:6b", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb474507-4f", "ovs_interfaceid": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:14:51.171637 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:14:51.172994 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-1625004851', uuid='4b54d0fc-613e-4ce1-8ba9-54651f4079bc'), owner=OwnerMeta(userid='2724dd8bb624423083210013b9f090aa', username='tempest-ServerStableDeviceRescueTest-1891281471-project-member', projectid='819c3d68b8b1459bbf07574e4b01f715', projectname='tempest-ServerStableDeviceRescueTest-1891281471'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "address": "fa:16:3e:ee:b3:6b", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb474507-4f", "ovs_interfaceid": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472891.172538) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:14:51.176874 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:14:51.177275 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:14:51.178788 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:14:51.179177 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:14:51.180415 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:14:51.180784 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:14:51.181106 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:14:51.181345 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:14:51.181511 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:14:51.181983 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:14:51.182198 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:14:51.182422 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:14:51.182639 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:14:51.183015 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:14:51.183184 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:14:51.183379 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:14:51.188152 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:14:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1625004851',display_name='tempest-ServerStableDeviceRescueTest-server-1625004851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstabledevicerescuetest-server-1625004851',id=93,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='819c3d68b8b1459bbf07574e4b01f715',ramdisk_id='',reservation_id='r-ewf5ju8k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1891281471',owner_user_name='tempest-ServerStableDeviceRescueTest-1891281471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:14:48Z,user_data=None,user_id='2724dd8bb624423083210013b9f090aa',uuid=4b54d0fc-613e-4ce1-8ba9-54651f4079bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "address": "fa:16:3e:ee:b3:6b", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb474507-4f", "ovs_interfaceid": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:14:51.188326 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converting VIF {"id": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "address": "fa:16:3e:ee:b3:6b", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb474507-4f", "ovs_interfaceid": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:14:51.189122 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b3:6b,bridge_name='br-int',has_traffic_filtering=True,id=eb474507-4ff1-42e7-ba50-0a3caae5255d,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb474507-4f') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:14:51.189858 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b54d0fc-613e-4ce1-8ba9-54651f4079bc {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] End _get_guest_xml xml= Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: instance-0000005d Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-server-1625004851 Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:14:51 Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-1891281471-project-member Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-1891281471 Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: Jan 26 19:14:51.693594 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:14:51.694911 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Preparing to wait for external event network-vif-plugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:14:51.694911 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:51.694911 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:51.694911 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:51.695658 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:14:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1625004851',display_name='tempest-ServerStableDeviceRescueTest-server-1625004851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstabledevicerescuetest-server-1625004851',id=93,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='819c3d68b8b1459bbf07574e4b01f715',ramdisk_id='',reservation_id='r-ewf5ju8k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1891281471',owner_user_name='tempest-ServerStableDeviceRescueTest-1891281471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:14:48Z,user_data=None,user_id='2724dd8bb624423083210013b9f090aa',uuid=4b54d0fc-613e-4ce1-8ba9-54651f4079bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "address": "fa:16:3e:ee:b3:6b", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb474507-4f", "ovs_interfaceid": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:14:51.695951 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converting VIF {"id": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "address": "fa:16:3e:ee:b3:6b", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb474507-4f", "ovs_interfaceid": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:14:51.696787 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b3:6b,bridge_name='br-int',has_traffic_filtering=True,id=eb474507-4ff1-42e7-ba50-0a3caae5255d,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb474507-4f') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:14:51.697082 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b3:6b,bridge_name='br-int',has_traffic_filtering=True,id=eb474507-4ff1-42e7-ba50-0a3caae5255d,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb474507-4f') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:14:51.697607 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:51.698208 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:14:51.698615 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:14:51.699458 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:51.699794 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '054f41f5-7172-5b0a-8dec-50bed51fcaab', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:14:51.701160 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:51.704257 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:14:51.707800 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:51.708181 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb474507-4f, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:14:51.708630 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb474507-4f, col_values=(('qos', UUID('895f9969-8a89-4e9f-ace6-f1c353ac9f24')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:14:51.708889 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb474507-4f, col_values=(('external_ids', {'iface-id': 'eb474507-4ff1-42e7-ba50-0a3caae5255d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:b3:6b', 'vm-uuid': '4b54d0fc-613e-4ce1-8ba9-54651f4079bc'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:14:51.710807 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:51.715795 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:14:51.728899 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:51.730090 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b3:6b,bridge_name='br-int',has_traffic_filtering=True,id=eb474507-4ff1-42e7-ba50-0a3caae5255d,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb474507-4f') Jan 26 19:14:53.032653 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:53.270540 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:14:53.270654 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:14:53.270872 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No VIF found with MAC fa:16:3e:ee:b3:6b, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:14:53.271385 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Using config drive Jan 26 19:14:53.777530 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:14:53.887010 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Creating config drive at /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk.config Jan 26 19:14:53.891407 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpypd08_4q {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:14:54.016374 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpypd08_4q" returned: 0 in 0.124s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:14:54.087299 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:54.092365 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:54.094073 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:54.098070 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:54.282789 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:14:54.282982 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] VM Started (Lifecycle Event) Jan 26 19:14:54.287059 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-90e15e78-858f-45ff-a863-81f6e990cf42 req-4454bfc5-ca75-41d4-9698-268706ef09ac service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received event network-vif-plugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:14:54.287059 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-90e15e78-858f-45ff-a863-81f6e990cf42 req-4454bfc5-ca75-41d4-9698-268706ef09ac service nova] Acquiring lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:54.287059 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-90e15e78-858f-45ff-a863-81f6e990cf42 req-4454bfc5-ca75-41d4-9698-268706ef09ac service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:54.287059 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-90e15e78-858f-45ff-a863-81f6e990cf42 req-4454bfc5-ca75-41d4-9698-268706ef09ac service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:54.287059 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-90e15e78-858f-45ff-a863-81f6e990cf42 req-4454bfc5-ca75-41d4-9698-268706ef09ac service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Processing event network-vif-plugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:14:54.287782 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:14:54.291094 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:14:54.295582 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Instance spawned successfully. Jan 26 19:14:54.295868 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:14:54.368644 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:54.373743 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:54.376398 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:54.786140 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:14:54.789552 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:14:54.807329 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:14:54.807329 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:14:54.807696 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:14:54.808013 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:14:54.808316 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:14:54.808651 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:14:55.293208 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:14:55.293208 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:14:55.293208 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] VM Paused (Lifecycle Event) Jan 26 19:14:55.312946 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Took 6.01 seconds to spawn the instance on the hypervisor. Jan 26 19:14:55.313120 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:14:55.798552 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:14:55.802251 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:14:55.802421 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] VM Resumed (Lifecycle Event) Jan 26 19:14:55.825341 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Took 11.28 seconds to build instance. Jan 26 19:14:56.306681 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:14:56.309241 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:14:56.316110 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3a4595d2-93bb-4af9-9370-1a63b714d9c1 req-4d4d125c-e8ee-439d-98ee-a9b618ef516c service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received event network-vif-plugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:14:56.316110 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3a4595d2-93bb-4af9-9370-1a63b714d9c1 req-4d4d125c-e8ee-439d-98ee-a9b618ef516c service nova] Acquiring lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:14:56.316110 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3a4595d2-93bb-4af9-9370-1a63b714d9c1 req-4d4d125c-e8ee-439d-98ee-a9b618ef516c service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:14:56.316110 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3a4595d2-93bb-4af9-9370-1a63b714d9c1 req-4d4d125c-e8ee-439d-98ee-a9b618ef516c service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:56.316110 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3a4595d2-93bb-4af9-9370-1a63b714d9c1 req-4d4d125c-e8ee-439d-98ee-a9b618ef516c service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] No waiting events found dispatching network-vif-plugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:14:56.316110 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-3a4595d2-93bb-4af9-9370-1a63b714d9c1 req-4d4d125c-e8ee-439d-98ee-a9b618ef516c service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received unexpected event network-vif-plugged-eb474507-4ff1-42e7-ba50-0a3caae5255d for instance with vm_state active and task_state None. Jan 26 19:14:56.329804 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9dc44fb6-ebb7-4206-9784-a35d30279062 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 12.797s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:14:56.712337 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:57.607940 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-f18977f4-f8a1-4e3d-84a5-b263b14ad555 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:14:58.036792 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:14:58.116052 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-f18977f4-f8a1-4e3d-84a5-b263b14ad555 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] instance snapshotting Jan 26 19:14:58.223545 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-f18977f4-f8a1-4e3d-84a5-b263b14ad555 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Beginning live snapshot process Jan 26 19:14:59.748541 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-f18977f4-f8a1-4e3d-84a5-b263b14ad555 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json -f qcow2 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:14:59.832267 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-f18977f4-f8a1-4e3d-84a5-b263b14ad555 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json -f qcow2" returned: 0 in 0.083s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:14:59.832801 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-f18977f4-f8a1-4e3d-84a5-b263b14ad555 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json -f qcow2 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:14:59.912607 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-f18977f4-f8a1-4e3d-84a5-b263b14ad555 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json -f qcow2" returned: 0 in 0.079s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:14:59.913581 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-f18977f4-f8a1-4e3d-84a5-b263b14ad555 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:14:59.918046 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-f18977f4-f8a1-4e3d-84a5-b263b14ad555 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:14:59.918559 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-f18977f4-f8a1-4e3d-84a5-b263b14ad555 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:00.036892 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-f18977f4-f8a1-4e3d-84a5-b263b14ad555 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.118s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:00.037346 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-f18977f4-f8a1-4e3d-84a5-b263b14ad555 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprpkvgylr/ed6022dc1c544c29b0917f177ccec233.delta 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:00.078561 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-f18977f4-f8a1-4e3d-84a5-b263b14ad555 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprpkvgylr/ed6022dc1c544c29b0917f177ccec233.delta 1073741824" returned: 0 in 0.041s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:00.078961 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-f18977f4-f8a1-4e3d-84a5-b263b14ad555 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Quiescing instance not available: QEMU guest agent is not enabled. Jan 26 19:15:00.145891 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-f18977f4-f8a1-4e3d-84a5-b263b14ad555 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=189076) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:845}} Jan 26 19:15:00.150959 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-f18977f4-f8a1-4e3d-84a5-b263b14ad555 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Skipping quiescing instance: QEMU guest agent is not enabled. Jan 26 19:15:00.192132 np0005596550.novalocal nova-compute[189076]: DEBUG nova.privsep.utils [None req-f18977f4-f8a1-4e3d-84a5-b263b14ad555 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=189076) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jan 26 19:15:00.192451 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-f18977f4-f8a1-4e3d-84a5-b263b14ad555 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprpkvgylr/ed6022dc1c544c29b0917f177ccec233.delta /opt/stack/data/nova/instances/snapshots/tmprpkvgylr/ed6022dc1c544c29b0917f177ccec233 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:00.480574 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-f18977f4-f8a1-4e3d-84a5-b263b14ad555 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprpkvgylr/ed6022dc1c544c29b0917f177ccec233.delta /opt/stack/data/nova/instances/snapshots/tmprpkvgylr/ed6022dc1c544c29b0917f177ccec233" returned: 0 in 0.288s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:00.480993 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-f18977f4-f8a1-4e3d-84a5-b263b14ad555 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Snapshot extracted, beginning image upload Jan 26 19:15:01.715897 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:03.035961 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:03.491507 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-f18977f4-f8a1-4e3d-84a5-b263b14ad555 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Snapshot image upload complete Jan 26 19:15:03.492466 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-f18977f4-f8a1-4e3d-84a5-b263b14ad555 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Took 5.37 seconds to snapshot the instance on the hypervisor. Jan 26 19:15:03.562684 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "62dba4cc-3bec-479a-9c7a-f656b5b91386" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:03.562932 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "62dba4cc-3bec-479a-9c7a-f656b5b91386" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:04.067594 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lazy-loading 'flavor' on Instance uuid 62dba4cc-3bec-479a-9c7a-f656b5b91386 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:15:04.571091 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Ignoring supplied device name: /dev/vdb Jan 26 19:15:05.074419 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "62dba4cc-3bec-479a-9c7a-f656b5b91386" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.511s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:05.931584 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Rescuing Jan 26 19:15:05.931866 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "refresh_cache-4b54d0fc-613e-4ce1-8ba9-54651f4079bc" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:15:05.931965 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquired lock "refresh_cache-4b54d0fc-613e-4ce1-8ba9-54651f4079bc" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:15:05.932120 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:15:06.223679 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "62dba4cc-3bec-479a-9c7a-f656b5b91386" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:06.223679 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "62dba4cc-3bec-479a-9c7a-f656b5b91386" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:06.223679 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Attaching volume d438bc89-fce8-47ba-bf8f-fd79987670fc to /dev/vdb Jan 26 19:15:06.405758 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': True, 'host': 'np0005596550.novalocal', 'execute': None}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:15:06.407064 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:06.412163 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.005s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:06.412273 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a312f41-0723-4033-aafc-0ee8a9cf2dc1]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:06.414047 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[5257064b-2111-4937-8e51-d00848ec41a8]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:15:06.414047 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:15:06.414047 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:15:06.414047 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:15:06.414047 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:06.414047 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:15:06.414047 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:15:06.414047 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:06.414047 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:15:06.414047 np0005596550.novalocal nova-compute[189076]: with open_scini_device() as fd: Jan 26 19:15:06.414047 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:06.414047 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:15:06.414047 np0005596550.novalocal nova-compute[189076]: return next(self.gen) Jan 26 19:15:06.414047 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^ Jan 26 19:15:06.414047 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:15:06.414047 np0005596550.novalocal nova-compute[189076]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:15:06.414047 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:06.414047 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:15:06.414293 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[5257064b-2111-4937-8e51-d00848ec41a8]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:06.414444 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.scaleio [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:15:06.414647 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.scaleio [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:15:06.416487 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:06.420724 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.005s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:06.421199 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6a26b6-98bc-4a96-8298-9bc09b1711d3]: (4, ('/dev/vda2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:06.422074 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:06.431270 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:06.431391 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d734b4-b7d2-4ab9-a60b-313b04a59225]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:06.432162 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d048de2-b62a-499d-88f6-610bb49e2b85]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:06.432440 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Running cmd (subprocess): nvme version {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:06.440782 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:15:06.461328 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] 'nvme version' failed. Not Retrying. {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:15:06.461537 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] nvme not present on system {{(pid=189076) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:15:06.463864 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=189076) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:15:06.464837 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.lightos [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:feeb:a58e', 'fe80::f445:7cff:fe9c:99d4', 'fe80::fc16:3eff:feee:b36b', 'fe80::602e:63ff:fe2e:9d73'] Jan 26 19:15:06.465015 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:15:06.465186 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:15:06.465455 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] <== get_connector_properties: return (59ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': True, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:feeb:a58e', 'fe80::f445:7cff:fe9c:99d4', 'fe80::fc16:3eff:feee:b36b', 'fe80::602e:63ff:fe2e:9d73']} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:15:06.465698 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.block_device [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Updating existing volume attachment record: 59fdad93-8cf6-473e-bf5c-7f2eb74495b7 {{(pid=189076) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jan 26 19:15:06.671850 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:15:06.717666 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:06.784551 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Updating instance_info_cache with network_info: [{"id": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "address": "fa:16:3e:ee:b3:6b", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb474507-4f", "ovs_interfaceid": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:15:07.288336 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Releasing lock "refresh_cache-4b54d0fc-613e-4ce1-8ba9-54651f4079bc" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:15:08.037302 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:08.948356 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:08.954707 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:08.956353 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:08.975469 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:08.984551 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:09.149261 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a5dc8eaa-08bf-4287-be9e-87a444b70d20 req-c54f1620-6cf9-4dfb-b2f4-70f7e54baeb2 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received event network-vif-unplugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:15:09.149307 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a5dc8eaa-08bf-4287-be9e-87a444b70d20 req-c54f1620-6cf9-4dfb-b2f4-70f7e54baeb2 service nova] Acquiring lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:09.149579 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a5dc8eaa-08bf-4287-be9e-87a444b70d20 req-c54f1620-6cf9-4dfb-b2f4-70f7e54baeb2 service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:09.149963 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a5dc8eaa-08bf-4287-be9e-87a444b70d20 req-c54f1620-6cf9-4dfb-b2f4-70f7e54baeb2 service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:09.150342 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a5dc8eaa-08bf-4287-be9e-87a444b70d20 req-c54f1620-6cf9-4dfb-b2f4-70f7e54baeb2 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] No waiting events found dispatching network-vif-unplugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:15:09.150426 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-a5dc8eaa-08bf-4287-be9e-87a444b70d20 req-c54f1620-6cf9-4dfb-b2f4-70f7e54baeb2 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received unexpected event network-vif-unplugged-eb474507-4ff1-42e7-ba50-0a3caae5255d for instance with vm_state active and task_state rescuing. Jan 26 19:15:09.183067 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Instance destroyed successfully. Jan 26 19:15:09.183393 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'numa_topology' on Instance uuid 4b54d0fc-613e-4ce1-8ba9-54651f4079bc {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:15:09.688670 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Attempting a stable device rescue Jan 26 19:15:09.748956 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk'}}} {{(pid=189076) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4599}} Jan 26 19:15:09.752605 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Instance directory exists: not creating {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5157}} Jan 26 19:15:09.752728 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Creating image(s) Jan 26 19:15:09.753266 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:09.753436 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:09.753986 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:09.754165 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4b54d0fc-613e-4ce1-8ba9-54651f4079bc {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:15:10.257439 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<4b54d0fc-613e-4ce1-8ba9-54651f4079bc> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:15:10.258030 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "64ab13af28d3a39f287192e8c7bacc98b16fccd8" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:10.258998 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "64ab13af28d3a39f287192e8c7bacc98b16fccd8" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:10.597449 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Calling os-brick to attach iSCSI Volume {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jan 26 19:15:10.598273 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc', 'target_lun': 0, 'volume_id': 'd438bc89-fce8-47ba-bf8f-fd79987670fc', 'auth_method': 'CHAP', 'auth_username': 'MZ4Dn2rVMJZW8cBoWJ6w', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:15:10.598490 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:15:10.598938 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:15:10.599107 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc', 'target_lun': 0, 'volume_id': 'd438bc89-fce8-47ba-bf8f-fd79987670fc', 'auth_method': 'CHAP', 'auth_username': 'MZ4Dn2rVMJZW8cBoWJ6w', 'auth_password': 'rExAB8c8ALuAJv9D', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True} {{(pid=189076) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:15:10.600076 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:10.606915 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:15:10.609549 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[618c3ab4-8f31-4b63-8011-ce6dd6aff30d]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:15:10.609549 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:15:10.609549 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:15:10.609549 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:15:10.609549 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:10.609549 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:15:10.609549 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:15:10.609549 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:10.609549 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:15:10.609549 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:15:10.609549 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:10.609549 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:15:10.609549 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:15:10.609549 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:10.609549 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:15:10.609549 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:15:10.609549 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:10.609549 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:15:10.609549 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:15:10.609549 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:15:10.609549 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:15:10.609549 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:15:10.610673 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[618c3ab4-8f31-4b63-8011-ce6dd6aff30d]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:10.611296 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:15:10.611806 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:15:10.612028 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:15:10.613198 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:10.626105 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260" returned: 21 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:10.626303 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[2831b418-456a-45e9-93f5-b752e95a1d87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:10.627711 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:15:10.627711 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:10.627711 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260 --interface default --op new {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:10.639544 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:10.639716 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca08e7ab-40d4-49bd-89fc-7256169e7b24]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:10.640113 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc] added Jan 26 19:15:10.640113 np0005596550.novalocal nova-compute[189076]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:15:10.640113 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:15:10.640113 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:15:10.640113 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:10.640252 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=189076) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:15:10.640526 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.028(s), this was the 1st time calling it. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:15:10.640698 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:15:10.998589 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:15:11.002676 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:15:11.003155 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ab13af28d3a39f287192e8c7bacc98b16fccd8.part --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:11.068669 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ab13af28d3a39f287192e8c7bacc98b16fccd8.part --force-share --output=json" returned: 0 in 0.065s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:11.069011 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.images [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] e1ab32c6-d6b2-461d-b146-98c1a7c5c39a was qcow2, converting to raw {{(pid=189076) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jan 26 19:15:11.071023 np0005596550.novalocal nova-compute[189076]: DEBUG nova.privsep.utils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=189076) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jan 26 19:15:11.071282 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/64ab13af28d3a39f287192e8c7bacc98b16fccd8.part /opt/stack/data/nova/instances/_base/64ab13af28d3a39f287192e8c7bacc98b16fccd8.converted {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:11.206061 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e617e3da-d291-4fdd-bb2e-6eef0c49cbf1 req-8a7ed5ec-bcec-4c0b-b86c-8cb5c8e9e0b1 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received event network-vif-unplugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:15:11.206257 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e617e3da-d291-4fdd-bb2e-6eef0c49cbf1 req-8a7ed5ec-bcec-4c0b-b86c-8cb5c8e9e0b1 service nova] Acquiring lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:11.206467 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e617e3da-d291-4fdd-bb2e-6eef0c49cbf1 req-8a7ed5ec-bcec-4c0b-b86c-8cb5c8e9e0b1 service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:11.206609 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e617e3da-d291-4fdd-bb2e-6eef0c49cbf1 req-8a7ed5ec-bcec-4c0b-b86c-8cb5c8e9e0b1 service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:11.206756 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e617e3da-d291-4fdd-bb2e-6eef0c49cbf1 req-8a7ed5ec-bcec-4c0b-b86c-8cb5c8e9e0b1 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] No waiting events found dispatching network-vif-unplugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:15:11.207007 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-e617e3da-d291-4fdd-bb2e-6eef0c49cbf1 req-8a7ed5ec-bcec-4c0b-b86c-8cb5c8e9e0b1 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received unexpected event network-vif-unplugged-eb474507-4ff1-42e7-ba50-0a3caae5255d for instance with vm_state active and task_state rescuing. Jan 26 19:15:11.642853 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:15:11.644734 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:11.657042 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:11.657669 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bbea1c-c6df-4b85-93be-45ada2d5644b]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.name = iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.tpgt = -1 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.startup = automatic Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.leading_login = No Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.iscsi_ifacename = default Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.net_ifacename = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.ipaddress = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.prefix_len = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.hwaddress = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.transport_name = tcp Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.initiatorname = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.state = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.vlan_id = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.vlan_priority = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.vlan_state = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.iface_num = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.mtu = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.port = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.bootproto = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.subnet_mask = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.gateway = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id_state = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.dhcp_dns = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.dhcp_learn_iqn = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.dhcp_req_vendor_id_state = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id_state = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.dhcp_slp_da = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.fragmentation = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.gratuitous_arp = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.incoming_forwarding = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.tos_state = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.tos = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.ttl = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.delayed_ack = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.tcp_nagle = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf_state = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.tcp_timer_scale = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.tcp_timestamp = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.redirect = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.def_task_mgmt_timeout = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.header_digest = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.data_digest = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.immediate_data = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.initial_r2t = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.data_seq_inorder = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.data_pdu_inorder = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.erl = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.max_receive_data_len = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.first_burst_len = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.max_outstanding_r2t = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.max_burst_len = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.chap_auth = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.bidi_chap = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.strict_login_compliance = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.discovery_auth = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: iface.discovery_logout = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.discovery_address = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.discovery_port = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.discovery_type = fw Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.initial_cmdsn = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.initial_login_retry_max = 8 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.xmit_thread_priority = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.cmds_max = 128 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.queue_depth = 32 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.nr_sessions = 1 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.auth.authmethod = None Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.auth.username = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.auth.password = *** Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.auth.username_in = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.auth.password_in = Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.timeo.replacement_timeout = 120 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FastAbort = Yes Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.InitialR2T = No Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ImmediateData = Yes Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxConnections = 1 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ERL = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.scan = auto Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.reopen_max = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.session.conn_reopen_log_freq = 1 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.conn[0].address = 38.102.83.18 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.conn[0].port = 3260 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.conn[0].startup = manual Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.window_size = 524288 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.DataDigest = None Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.IFMarker = No Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.OFMarker = No Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: # END RECORD Jan 26 19:15:11.659386 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:11.661594 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:11.675473 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.014s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:11.675861 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f337e7-852c-413b-8c57-469557edb380]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:11.676598 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:11.678193 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:11.683181 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/64ab13af28d3a39f287192e8c7bacc98b16fccd8.part /opt/stack/data/nova/instances/_base/64ab13af28d3a39f287192e8c7bacc98b16fccd8.converted" returned: 0 in 0.612s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:11.687589 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ab13af28d3a39f287192e8c7bacc98b16fccd8.converted --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:11.699436 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:11.699909 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f42515-9ec3-4aef-bcf6-ce47b006b1fc]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:11.701585 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:11.703218 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260 --op update -n node.session.auth.username -v MZ4Dn2rVMJZW8cBoWJ6w {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:11.716729 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260 --op update -n node.session.auth.username -v MZ4Dn2rVMJZW8cBoWJ6w" returned: 0 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:11.716950 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[749a78f0-11f7-429b-8ed9-200b0dc15e66]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:11.717353 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MZ4Dn2rVMJZW8cBoWJ6w'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:11.720471 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:11.720471 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:11.731597 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:11.731982 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bfaba8-1bb2-4194-bc9d-3fef776d8d9b]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:11.732854 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:11.733967 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:11.743687 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:11.743962 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e875e4-a3a4-49d9-9d03-9803208307bf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:11.744398 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jan 26 19:15:11.744398 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:15:11.744669 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jan 26 19:15:11.744669 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:15:11.745011 np0005596550.novalocal nova-compute[189076]: WARNING os_brick.initiator.connectors.iscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jan 26 19:15:11.745011 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:11.745807 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260 --login {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:11.761602 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260 --login" returned: 0 in 0.015s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:11.761717 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4678c534-97db-432f-b813-67f104aa15fb]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:11.762180 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc, portal: 38.102.83.18,3260] successful. Jan 26 19:15:11.762180 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:11.763517 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:11.773038 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:11.773194 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4479d941-7484-4026-affb-e01d6c7e6aac]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:11.773678 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:11.774795 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:11.783072 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ab13af28d3a39f287192e8c7bacc98b16fccd8.converted --force-share --output=json" returned: 0 in 0.096s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:11.783715 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "64ab13af28d3a39f287192e8c7bacc98b16fccd8" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.525s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:11.784274 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:15:11.788848 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:15:11.789340 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:11.789486 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[307bc49b-ce62-4a2d-b898-3bdebcc8d1c7]: (4, ('tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:11.790257 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash) Jan 26 19:15:11.790257 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:15:11.790473 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsi session list stdout=tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash) Jan 26 19:15:11.790473 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:15:11.790900 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:15:11.791086 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Connected to 38.102.83.18:3260 {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:15:11.791573 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] HCTL ('2', '-', '-', 0) found on session 23 with lun 0 {{(pid=189076) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:15:11.791711 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Scanning host 2 c: -, t: -, l: 0) {{(pid=189076) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:15:11.792186 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "64ab13af28d3a39f287192e8c7bacc98b16fccd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:11.792506 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "64ab13af28d3a39f287192e8c7bacc98b16fccd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:11.792801 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:15:11.795313 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:15:11.795600 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ab13af28d3a39f287192e8c7bacc98b16fccd8 --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:11.802383 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host2/scan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:11.817605 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host2/scan" returned: 0 in 0.025s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:11.818192 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[5862f729-91fc-4fc2-98d1-9fa1d8e7c221]: (4, ('- - 0', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:11.818627 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Searching for a device in session 23 and hctl ['2', '*', '*', 0] yield: None {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:15:11.899760 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ab13af28d3a39f287192e8c7bacc98b16fccd8 --force-share --output=json" returned: 0 in 0.104s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:11.900592 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/64ab13af28d3a39f287192e8c7bacc98b16fccd8,backing_fmt=raw /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk.rescue {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:12.281422 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/64ab13af28d3a39f287192e8c7bacc98b16fccd8,backing_fmt=raw /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk.rescue" returned: 0 in 0.380s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:12.281957 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "64ab13af28d3a39f287192e8c7bacc98b16fccd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.489s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:12.282314 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'migration_context' on Instance uuid 4b54d0fc-613e-4ce1-8ba9-54651f4079bc {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:15:12.786683 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<4b54d0fc-613e-4ce1-8ba9-54651f4079bc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:15:12.787074 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:15:12.789014 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Start _get_guest_xml network_info=[{"id": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "address": "fa:16:3e:ee:b3:6b", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "vif_mac": "fa:16:3e:ee:b3:6b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb474507-4f", "ovs_interfaceid": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue={'image_id': 'e1ab32c6-d6b2-461d-b146-98c1a7c5c39a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:15:12.789210 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'resources' on Instance uuid 4b54d0fc-613e-4ce1-8ba9-54651f4079bc {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:15:12.819711 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Searching for a device in session 23 and hctl ['2', '*', '*', 0] yield: sda {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:15:12.820433 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Connected to sda using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc', 'target_lun': 0, 'volume_id': 'd438bc89-fce8-47ba-bf8f-fd79987670fc', 'auth_method': 'CHAP', 'auth_username': 'MZ4Dn2rVMJZW8cBoWJ6w', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True} {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:15:12.821250 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.222s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:15:12.821518 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] <== connect_volume: return (2222ms) {'type': 'block', 'scsi_wwn': '3600140598410b78bf5649279f8750800', 'path': '/dev/sda'} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:15:12.821775 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3600140598410b78bf5649279f8750800', 'path': '/dev/sda'} {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jan 26 19:15:12.825515 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lazy-loading 'flavor' on Instance uuid 62dba4cc-3bec-479a-9c7a-f656b5b91386 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:15:13.291525 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<4b54d0fc-613e-4ce1-8ba9-54651f4079bc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:15:13.297398 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:15:13.298569 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-1625004851', uuid='4b54d0fc-613e-4ce1-8ba9-54651f4079bc'), owner=OwnerMeta(userid='2724dd8bb624423083210013b9f090aa', username='tempest-ServerStableDeviceRescueTest-1891281471-project-member', projectid='819c3d68b8b1459bbf07574e4b01f715', projectname='tempest-ServerStableDeviceRescueTest-1891281471'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "address": "fa:16:3e:ee:b3:6b", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "vif_mac": "fa:16:3e:ee:b3:6b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb474507-4f", "ovs_interfaceid": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472913.298188) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:15:13.300521 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:15:13.300894 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:15:13.301876 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:15:13.302257 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:15:13.303202 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:15:13.303552 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:15:13.303736 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:15:13.303896 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:15:13.304068 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:15:13.304188 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:15:13.304304 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:15:13.304484 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:15:13.304614 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:15:13.304753 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:15:13.305023 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:15:13.305182 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:15:13.305348 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4b54d0fc-613e-4ce1-8ba9-54651f4079bc {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:15:13.331539 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] attach device xml: Jan 26 19:15:13.331539 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:13.331539 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:13.331539 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:13.331539 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:13.331539 np0005596550.novalocal nova-compute[189076]: d438bc89-fce8-47ba-bf8f-fd79987670fc Jan 26 19:15:13.331539 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:13.331539 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:330}} Jan 26 19:15:13.867062 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<4b54d0fc-613e-4ce1-8ba9-54651f4079bc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:15:13.867062 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk.config --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:13.893355 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk.config --force-share --output=json" returned: 0 in 0.075s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:13.893736 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:13.894005 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:13.894598 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:13.896063 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:14:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1625004851',display_name='tempest-ServerStableDeviceRescueTest-server-1625004851',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstabledevicerescuetest-server-1625004851',id=93,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:14:55Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='819c3d68b8b1459bbf07574e4b01f715',ramdisk_id='',reservation_id='r-ewf5ju8k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1891281471',owner_user_name='tempest-ServerStableDeviceRescueTest-1891281471-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:15:03Z,user_data=None,user_id='2724dd8bb624423083210013b9f090aa',uuid=4b54d0fc-613e-4ce1-8ba9-54651f4079bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "address": "fa:16:3e:ee:b3:6b", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "vif_mac": "fa:16:3e:ee:b3:6b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb474507-4f", "ovs_interfaceid": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:15:13.896321 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converting VIF {"id": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "address": "fa:16:3e:ee:b3:6b", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "vif_mac": "fa:16:3e:ee:b3:6b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb474507-4f", "ovs_interfaceid": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:15:13.897365 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:b3:6b,bridge_name='br-int',has_traffic_filtering=True,id=eb474507-4ff1-42e7-ba50-0a3caae5255d,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb474507-4f') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:15:13.898036 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b54d0fc-613e-4ce1-8ba9-54651f4079bc {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<4b54d0fc-613e-4ce1-8ba9-54651f4079bc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] End _get_guest_xml xml= Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: instance-0000005d Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-server-1625004851 Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:15:13 Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: ide Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: pc Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-1891281471-project-member Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-1891281471 Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:14.403414 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:15:14.413472 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Instance destroyed successfully. Jan 26 19:15:14.914790 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:15:14.914790 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] No BDM found with device name vdb, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:15:14.914790 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:15:14.914790 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] No VIF found with MAC fa:16:3e:eb:a5:8e, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:15:15.934737 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:15:15.935217 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:15:15.935217 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name sda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:15:15.935217 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No VIF found with MAC fa:16:3e:ee:b3:6b, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:15:15.936069 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Using config drive Jan 26 19:15:16.498298 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'ec2_ids' on Instance uuid 4b54d0fc-613e-4ce1-8ba9-54651f4079bc {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:15:16.500534 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-f684ba6e-14bd-4244-addc-050d0c268861 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "62dba4cc-3bec-479a-9c7a-f656b5b91386" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 10.292s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:16.724793 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:17.002194 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<4b54d0fc-613e-4ce1-8ba9-54651f4079bc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:15:17.002523 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'keypairs' on Instance uuid 4b54d0fc-613e-4ce1-8ba9-54651f4079bc {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:15:17.506651 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<4b54d0fc-613e-4ce1-8ba9-54651f4079bc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:15:17.511632 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:15:17.609760 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Creating config drive at /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk.config.rescue Jan 26 19:15:17.614249 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpvjpy_4oi {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:17.743741 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpvjpy_4oi" returned: 0 in 0.129s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:17.814386 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:17.824757 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:18.042624 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:18.078533 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for 4b54d0fc-613e-4ce1-8ba9-54651f4079bc due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:15:18.078533 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:15:18.078533 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] VM Resumed (Lifecycle Event) Jan 26 19:15:18.087801 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-afbe983e-afbd-4664-a19d-298ddb2eb1f9 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:15:18.178760 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:18.594293 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:15:18.597823 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:15:19.100591 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:15:19.100891 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] VM Started (Lifecycle Event) Jan 26 19:15:19.604135 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:15:19.609884 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:15:20.056727 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-587c7764-6122-42b9-9bd4-6bdb74768475 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Unrescuing Jan 26 19:15:20.057016 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-587c7764-6122-42b9-9bd4-6bdb74768475 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "refresh_cache-4b54d0fc-613e-4ce1-8ba9-54651f4079bc" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:15:20.057204 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-587c7764-6122-42b9-9bd4-6bdb74768475 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquired lock "refresh_cache-4b54d0fc-613e-4ce1-8ba9-54651f4079bc" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:15:20.057374 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-587c7764-6122-42b9-9bd4-6bdb74768475 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:15:20.115164 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] During sync_power_state the instance has a pending task (unrescuing). Skip. Jan 26 19:15:20.324357 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-27cd6e78-4bad-4485-94d5-45db5266999a req-05475540-e1bc-48ce-bb5a-80408c0472fd service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received event network-vif-plugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:15:20.324357 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-27cd6e78-4bad-4485-94d5-45db5266999a req-05475540-e1bc-48ce-bb5a-80408c0472fd service nova] Acquiring lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:20.324357 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-27cd6e78-4bad-4485-94d5-45db5266999a req-05475540-e1bc-48ce-bb5a-80408c0472fd service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:20.324357 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-27cd6e78-4bad-4485-94d5-45db5266999a req-05475540-e1bc-48ce-bb5a-80408c0472fd service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:20.324357 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-27cd6e78-4bad-4485-94d5-45db5266999a req-05475540-e1bc-48ce-bb5a-80408c0472fd service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] No waiting events found dispatching network-vif-plugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:15:20.325740 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-27cd6e78-4bad-4485-94d5-45db5266999a req-05475540-e1bc-48ce-bb5a-80408c0472fd service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received unexpected event network-vif-plugged-eb474507-4ff1-42e7-ba50-0a3caae5255d for instance with vm_state rescued and task_state unrescuing. Jan 26 19:15:20.402638 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:15:20.562882 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-587c7764-6122-42b9-9bd4-6bdb74768475 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:15:20.815399 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-587c7764-6122-42b9-9bd4-6bdb74768475 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:15:20.911049 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:20.911361 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:20.911552 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:20.911748 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:15:20.982780 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-587c7764-6122-42b9-9bd4-6bdb74768475 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Updating instance_info_cache with network_info: [{"id": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "address": "fa:16:3e:ee:b3:6b", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb474507-4f", "ovs_interfaceid": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:15:21.485795 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-587c7764-6122-42b9-9bd4-6bdb74768475 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Releasing lock "refresh_cache-4b54d0fc-613e-4ce1-8ba9-54651f4079bc" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:15:21.486300 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-587c7764-6122-42b9-9bd4-6bdb74768475 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'flavor' on Instance uuid 4b54d0fc-613e-4ce1-8ba9-54651f4079bc {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:15:21.722546 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:21.959751 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:22.031310 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:22.052899 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:22.060713 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:22.061093 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:22.098147 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:22.099328 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:22.152023 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:22.152761 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk.rescue --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:22.234402 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk.rescue --force-share --output=json" returned: 0 in 0.081s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:22.234402 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk.rescue --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:22.292328 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Instance destroyed successfully. Jan 26 19:15:22.292756 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-587c7764-6122-42b9-9bd4-6bdb74768475 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'numa_topology' on Instance uuid 4b54d0fc-613e-4ce1-8ba9-54651f4079bc {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:15:22.348261 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk.rescue --force-share --output=json" returned: 0 in 0.113s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:22.355192 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dba4cc-3bec-479a-9c7a-f656b5b91386/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:22.397090 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7c20db8c-6298-409c-a33c-b92c40140791 req-24175a65-d888-46d9-ab2f-b372a40f9a10 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received event network-vif-plugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:15:22.397414 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7c20db8c-6298-409c-a33c-b92c40140791 req-24175a65-d888-46d9-ab2f-b372a40f9a10 service nova] Acquiring lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:22.397506 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7c20db8c-6298-409c-a33c-b92c40140791 req-24175a65-d888-46d9-ab2f-b372a40f9a10 service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:22.397631 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7c20db8c-6298-409c-a33c-b92c40140791 req-24175a65-d888-46d9-ab2f-b372a40f9a10 service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:22.397896 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7c20db8c-6298-409c-a33c-b92c40140791 req-24175a65-d888-46d9-ab2f-b372a40f9a10 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] No waiting events found dispatching network-vif-plugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:15:22.398074 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-7c20db8c-6298-409c-a33c-b92c40140791 req-24175a65-d888-46d9-ab2f-b372a40f9a10 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received unexpected event network-vif-plugged-eb474507-4ff1-42e7-ba50-0a3caae5255d for instance with vm_state rescued and task_state unrescuing. Jan 26 19:15:22.398153 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7c20db8c-6298-409c-a33c-b92c40140791 req-24175a65-d888-46d9-ab2f-b372a40f9a10 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received event network-vif-unplugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:15:22.398292 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7c20db8c-6298-409c-a33c-b92c40140791 req-24175a65-d888-46d9-ab2f-b372a40f9a10 service nova] Acquiring lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:22.399229 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7c20db8c-6298-409c-a33c-b92c40140791 req-24175a65-d888-46d9-ab2f-b372a40f9a10 service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:22.399425 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7c20db8c-6298-409c-a33c-b92c40140791 req-24175a65-d888-46d9-ab2f-b372a40f9a10 service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:22.399568 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7c20db8c-6298-409c-a33c-b92c40140791 req-24175a65-d888-46d9-ab2f-b372a40f9a10 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] No waiting events found dispatching network-vif-unplugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:15:22.399742 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-7c20db8c-6298-409c-a33c-b92c40140791 req-24175a65-d888-46d9-ab2f-b372a40f9a10 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received unexpected event network-vif-unplugged-eb474507-4ff1-42e7-ba50-0a3caae5255d for instance with vm_state rescued and task_state unrescuing. Jan 26 19:15:22.442538 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dba4cc-3bec-479a-9c7a-f656b5b91386/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:22.442898 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dba4cc-3bec-479a-9c7a-f656b5b91386/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:22.531623 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dba4cc-3bec-479a-9c7a-f656b5b91386/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:22.532078 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] skipping disk /dev/sda (vdb) as it is a volume {{(pid=189076) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12209}} Jan 26 19:15:22.647484 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:15:22.647602 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:22.669244 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.021s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:22.669610 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=7405MB free_disk=372.89230728149414GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:15:22.669804 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:22.670194 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:22.797727 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-587c7764-6122-42b9-9bd4-6bdb74768475 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<4b54d0fc-613e-4ce1-8ba9-54651f4079bc> lazy-loaded attributes: flavor,numa_topology {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:15:22.880509 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:22.887369 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:22.901303 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:23.119875 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for 4b54d0fc-613e-4ce1-8ba9-54651f4079bc due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:15:23.120022 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:15:23.120188 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] VM Resumed (Lifecycle Event) Jan 26 19:15:23.122270 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-587c7764-6122-42b9-9bd4-6bdb74768475 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:15:23.241018 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:23.249082 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:23.256386 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:23.259535 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:23.624739 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:15:23.630791 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:15:23.802405 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 62dba4cc-3bec-479a-9c7a-f656b5b91386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:15:23.803672 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 4b54d0fc-613e-4ce1-8ba9-54651f4079bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:15:23.803672 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 2 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:15:23.803672 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=896MB phys_disk=399GB used_disk=2GB total_vcpus=8 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:15:22 up 43 min, 13 users, load average: 4.13, 4.65, 4.20\n', 'num_instances': '2', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '2', 'num_proj_261cb1c98c954302ba86efa2ceee43f2': '1', 'io_workload': '0', 'num_vm_rescued': '1', 'num_task_unrescuing': '1', 'num_proj_819c3d68b8b1459bbf07574e4b01f715': '1'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:15:23.963872 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:15:24.133179 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:15:24.133381 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] VM Started (Lifecycle Event) Jan 26 19:15:24.453647 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d49738f3-4ec9-44e0-90a1-d6732ff220b0 req-889b460f-3e29-4282-9775-6018ba3dcfa0 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received event network-vif-unplugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:15:24.455990 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d49738f3-4ec9-44e0-90a1-d6732ff220b0 req-889b460f-3e29-4282-9775-6018ba3dcfa0 service nova] Acquiring lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:24.456175 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d49738f3-4ec9-44e0-90a1-d6732ff220b0 req-889b460f-3e29-4282-9775-6018ba3dcfa0 service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:24.456335 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d49738f3-4ec9-44e0-90a1-d6732ff220b0 req-889b460f-3e29-4282-9775-6018ba3dcfa0 service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:24.456520 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d49738f3-4ec9-44e0-90a1-d6732ff220b0 req-889b460f-3e29-4282-9775-6018ba3dcfa0 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] No waiting events found dispatching network-vif-unplugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:15:24.456723 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-d49738f3-4ec9-44e0-90a1-d6732ff220b0 req-889b460f-3e29-4282-9775-6018ba3dcfa0 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received unexpected event network-vif-unplugged-eb474507-4ff1-42e7-ba50-0a3caae5255d for instance with vm_state active and task_state None. Jan 26 19:15:24.458408 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d49738f3-4ec9-44e0-90a1-d6732ff220b0 req-889b460f-3e29-4282-9775-6018ba3dcfa0 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received event network-vif-plugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:15:24.458668 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d49738f3-4ec9-44e0-90a1-d6732ff220b0 req-889b460f-3e29-4282-9775-6018ba3dcfa0 service nova] Acquiring lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:24.458987 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d49738f3-4ec9-44e0-90a1-d6732ff220b0 req-889b460f-3e29-4282-9775-6018ba3dcfa0 service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:24.459189 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d49738f3-4ec9-44e0-90a1-d6732ff220b0 req-889b460f-3e29-4282-9775-6018ba3dcfa0 service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:24.459394 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d49738f3-4ec9-44e0-90a1-d6732ff220b0 req-889b460f-3e29-4282-9775-6018ba3dcfa0 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] No waiting events found dispatching network-vif-plugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:15:24.461591 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-d49738f3-4ec9-44e0-90a1-d6732ff220b0 req-889b460f-3e29-4282-9775-6018ba3dcfa0 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received unexpected event network-vif-plugged-eb474507-4ff1-42e7-ba50-0a3caae5255d for instance with vm_state active and task_state None. Jan 26 19:15:24.461591 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d49738f3-4ec9-44e0-90a1-d6732ff220b0 req-889b460f-3e29-4282-9775-6018ba3dcfa0 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received event network-vif-plugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:15:24.461591 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d49738f3-4ec9-44e0-90a1-d6732ff220b0 req-889b460f-3e29-4282-9775-6018ba3dcfa0 service nova] Acquiring lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:24.461591 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d49738f3-4ec9-44e0-90a1-d6732ff220b0 req-889b460f-3e29-4282-9775-6018ba3dcfa0 service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:24.461591 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d49738f3-4ec9-44e0-90a1-d6732ff220b0 req-889b460f-3e29-4282-9775-6018ba3dcfa0 service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:24.461591 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d49738f3-4ec9-44e0-90a1-d6732ff220b0 req-889b460f-3e29-4282-9775-6018ba3dcfa0 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] No waiting events found dispatching network-vif-plugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:15:24.461892 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-d49738f3-4ec9-44e0-90a1-d6732ff220b0 req-889b460f-3e29-4282-9775-6018ba3dcfa0 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received unexpected event network-vif-plugged-eb474507-4ff1-42e7-ba50-0a3caae5255d for instance with vm_state active and task_state None. Jan 26 19:15:24.466823 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:15:24.639723 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:15:24.644549 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:15:24.973361 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:15:24.973529 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.303s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:25.468244 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:15:25.468491 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:15:25.468718 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:15:25.512169 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:25.512169 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:26.014062 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:15:26.595060 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:26.595345 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:26.599587 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:15:26.599788 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Claim successful on node np0005596550.novalocal Jan 26 19:15:26.727649 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:26.895961 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:15:27.770345 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:15:27.895069 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:15:27.895351 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:15:27.895539 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:15:28.046811 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:28.276443 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:15:28.790852 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.193s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:28.790852 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:15:28.892897 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:15:29.301808 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:15:29.301808 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:15:29.301808 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:15:29.301808 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:15:29.359098 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2724dd8bb624423083210013b9f090aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3d68b8b1459bbf07574e4b01f715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:15:29.800979 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:15:30.055074 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Successfully created port: fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:15:30.306998 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:15:30.602585 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Successfully updated port: fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:15:30.662644 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5a30fadb-17ba-4496-b068-985d20c1270d req-efc44100-efa5-4b1b-896c-5ba6702baab5 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received event network-changed-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:15:30.662802 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5a30fadb-17ba-4496-b068-985d20c1270d req-efc44100-efa5-4b1b-896c-5ba6702baab5 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Refreshing instance network info cache due to event network-changed-fdd0122a-d9ce-48b0-9f2c-156c89334d0b. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:15:30.662979 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5a30fadb-17ba-4496-b068-985d20c1270d req-efc44100-efa5-4b1b-896c-5ba6702baab5 service nova] Acquiring lock "refresh_cache-26e2c1ab-94b1-4731-afc4-9c987e187c8d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:15:30.663092 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5a30fadb-17ba-4496-b068-985d20c1270d req-efc44100-efa5-4b1b-896c-5ba6702baab5 service nova] Acquired lock "refresh_cache-26e2c1ab-94b1-4731-afc4-9c987e187c8d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:15:30.663234 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-5a30fadb-17ba-4496-b068-985d20c1270d req-efc44100-efa5-4b1b-896c-5ba6702baab5 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Refreshing network info cache for port fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:15:31.106491 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "refresh_cache-26e2c1ab-94b1-4731-afc4-9c987e187c8d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:15:31.168317 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-5a30fadb-17ba-4496-b068-985d20c1270d req-efc44100-efa5-4b1b-896c-5ba6702baab5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:15:31.260563 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-5a30fadb-17ba-4496-b068-985d20c1270d req-efc44100-efa5-4b1b-896c-5ba6702baab5 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:15:31.322664 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:15:31.322664 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:15:31.322664 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Creating image(s) Jan 26 19:15:31.328819 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "/opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:31.328819 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:31.328819 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:31.328819 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:15:31.332365 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:15:31.346617 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:31.394034 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-5a30fadb-17ba-4496-b068-985d20c1270d req-efc44100-efa5-4b1b-896c-5ba6702baab5 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:15:31.438097 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.091s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:31.438667 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:31.439486 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:31.440246 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:15:31.445543 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:15:31.446081 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:31.530810 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.084s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:31.531133 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:31.589797 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk 1073741824" returned: 0 in 0.055s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:31.589797 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.148s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:31.589797 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:31.676800 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.087s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:31.676800 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Checking if we can resize image /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:15:31.676800 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:31.729842 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:31.780801 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:31.780996 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Cannot resize image /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:15:31.781499 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:15:31.781866 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Ensure instance console log exists: /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:15:31.782596 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:31.782978 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:31.783263 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:31.898861 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5a30fadb-17ba-4496-b068-985d20c1270d req-efc44100-efa5-4b1b-896c-5ba6702baab5 service nova] Releasing lock "refresh_cache-26e2c1ab-94b1-4731-afc4-9c987e187c8d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:15:31.899642 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquired lock "refresh_cache-26e2c1ab-94b1-4731-afc4-9c987e187c8d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:15:31.899964 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:15:32.461080 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:15:32.615606 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:15:32.716786 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Updating instance_info_cache with network_info: [{"id": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "address": "fa:16:3e:21:d5:2c", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd0122a-d9", "ovs_interfaceid": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:15:33.049566 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:33.227525 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Releasing lock "refresh_cache-26e2c1ab-94b1-4731-afc4-9c987e187c8d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:15:33.227525 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Instance network_info: |[{"id": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "address": "fa:16:3e:21:d5:2c", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd0122a-d9", "ovs_interfaceid": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:15:33.227525 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Start _get_guest_xml network_info=[{"id": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "address": "fa:16:3e:21:d5:2c", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd0122a-d9", "ovs_interfaceid": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:15:33.231036 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:15:33.232524 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-844896935', uuid='26e2c1ab-94b1-4731-afc4-9c987e187c8d'), owner=OwnerMeta(userid='2724dd8bb624423083210013b9f090aa', username='tempest-ServerStableDeviceRescueTest-1891281471-project-member', projectid='819c3d68b8b1459bbf07574e4b01f715', projectname='tempest-ServerStableDeviceRescueTest-1891281471'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "address": "fa:16:3e:21:d5:2c", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd0122a-d9", "ovs_interfaceid": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472933.232113) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:15:33.234009 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:15:33.234639 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:15:33.235855 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:15:33.236434 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:15:33.237584 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:15:33.238074 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:15:33.238543 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:15:33.238798 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:15:33.239064 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:15:33.239298 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:15:33.239546 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:15:33.239867 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:15:33.240127 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:15:33.240380 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:15:33.240634 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:15:33.241012 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:15:33.244093 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-844896935',display_name='tempest-ServerStableDeviceRescueTest-server-844896935',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstabledevicerescuetest-server-844896935',id=94,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='819c3d68b8b1459bbf07574e4b01f715',ramdisk_id='',reservation_id='r-yocl0nfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1891281471',owner_user_name='tempest-ServerStableDeviceRescueTest-1891281471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:15:30Z,user_data=None,user_id='2724dd8bb624423083210013b9f090aa',uuid=26e2c1ab-94b1-4731-afc4-9c987e187c8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "address": "fa:16:3e:21:d5:2c", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd0122a-d9", "ovs_interfaceid": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:15:33.244453 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converting VIF {"id": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "address": "fa:16:3e:21:d5:2c", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd0122a-d9", "ovs_interfaceid": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:15:33.245080 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:d5:2c,bridge_name='br-int',has_traffic_filtering=True,id=fdd0122a-d9ce-48b0-9f2c-156c89334d0b,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd0122a-d9') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:15:33.245637 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'pci_devices' on Instance uuid 26e2c1ab-94b1-4731-afc4-9c987e187c8d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] End _get_guest_xml xml= Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: 26e2c1ab-94b1-4731-afc4-9c987e187c8d Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: instance-0000005e Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-server-844896935 Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:15:33 Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-1891281471-project-member Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-1891281471 Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: 26e2c1ab-94b1-4731-afc4-9c987e187c8d Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: 26e2c1ab-94b1-4731-afc4-9c987e187c8d Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:15:33.750816 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Preparing to wait for external event network-vif-plugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:15:33.756789 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:33.756789 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.003s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:33.756789 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:33.756789 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-844896935',display_name='tempest-ServerStableDeviceRescueTest-server-844896935',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstabledevicerescuetest-server-844896935',id=94,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='819c3d68b8b1459bbf07574e4b01f715',ramdisk_id='',reservation_id='r-yocl0nfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1891281471',owner_user_name='tempest-ServerStableDeviceRescueTest-1891281471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:15:30Z,user_data=None,user_id='2724dd8bb624423083210013b9f090aa',uuid=26e2c1ab-94b1-4731-afc4-9c987e187c8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "address": "fa:16:3e:21:d5:2c", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd0122a-d9", "ovs_interfaceid": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:15:33.757061 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converting VIF {"id": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "address": "fa:16:3e:21:d5:2c", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd0122a-d9", "ovs_interfaceid": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:15:33.757061 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:d5:2c,bridge_name='br-int',has_traffic_filtering=True,id=fdd0122a-d9ce-48b0-9f2c-156c89334d0b,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd0122a-d9') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:15:33.757061 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:d5:2c,bridge_name='br-int',has_traffic_filtering=True,id=fdd0122a-d9ce-48b0-9f2c-156c89334d0b,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd0122a-d9') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:15:33.757061 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:33.759326 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:15:33.759326 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:15:33.759326 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:33.759326 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ed22e66-5aef-5a16-9d44-39865559d9d1', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:15:33.802605 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:33.806110 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:15:33.810600 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:33.810978 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfdd0122a-d9, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:15:33.811445 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfdd0122a-d9, col_values=(('qos', UUID('5e1f5c7a-c89a-4305-8474-858acc647f40')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:15:33.811742 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfdd0122a-d9, col_values=(('external_ids', {'iface-id': 'fdd0122a-d9ce-48b0-9f2c-156c89334d0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:d5:2c', 'vm-uuid': '26e2c1ab-94b1-4731-afc4-9c987e187c8d'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:15:33.813185 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:33.815853 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:15:33.823411 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:33.824645 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:d5:2c,bridge_name='br-int',has_traffic_filtering=True,id=fdd0122a-d9ce-48b0-9f2c-156c89334d0b,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd0122a-d9') Jan 26 19:15:33.891986 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:15:35.366369 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:15:35.368579 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:15:35.368579 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No VIF found with MAC fa:16:3e:21:d5:2c, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:15:35.368579 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Using config drive Jan 26 19:15:35.876802 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:15:35.961835 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Creating config drive at /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk.config Jan 26 19:15:35.964024 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpmhlf_bka {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:36.095658 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpmhlf_bka" returned: 0 in 0.131s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:36.179794 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:36.190344 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:36.195392 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:36.330246 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7df7c0e1-9e53-47ff-9cf8-ccb5ad7465d7 req-a7cd526a-a57d-4a7d-9b93-6215dba0a7a8 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received event network-vif-plugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:15:36.330577 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7df7c0e1-9e53-47ff-9cf8-ccb5ad7465d7 req-a7cd526a-a57d-4a7d-9b93-6215dba0a7a8 service nova] Acquiring lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:36.331382 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7df7c0e1-9e53-47ff-9cf8-ccb5ad7465d7 req-a7cd526a-a57d-4a7d-9b93-6215dba0a7a8 service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:36.331690 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7df7c0e1-9e53-47ff-9cf8-ccb5ad7465d7 req-a7cd526a-a57d-4a7d-9b93-6215dba0a7a8 service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:36.331996 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7df7c0e1-9e53-47ff-9cf8-ccb5ad7465d7 req-a7cd526a-a57d-4a7d-9b93-6215dba0a7a8 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Processing event network-vif-plugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:15:36.337462 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:36.338634 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:36.351018 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:15:36.352352 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:15:36.352434 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] VM Started (Lifecycle Event) Jan 26 19:15:36.355645 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:15:36.364342 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Instance spawned successfully. Jan 26 19:15:36.364342 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:15:36.859588 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:15:36.863136 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:15:36.875946 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:15:36.875946 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:15:36.876185 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:15:36.876392 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:15:36.876832 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:15:36.877810 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:15:37.367593 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:15:37.367867 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:15:37.368002 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] VM Paused (Lifecycle Event) Jan 26 19:15:37.383623 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Took 6.06 seconds to spawn the instance on the hypervisor. Jan 26 19:15:37.383916 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:15:37.872591 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:15:37.898308 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Took 11.38 seconds to build instance. Jan 26 19:15:37.904781 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:15:37.904852 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] VM Resumed (Lifecycle Event) Jan 26 19:15:38.050477 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:38.375494 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-aa1c07cf-2b39-4967-80e3-a588af37c935 req-bde5660a-5c96-4ab7-9c64-d63abe89e711 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received event network-vif-plugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:15:38.375494 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-aa1c07cf-2b39-4967-80e3-a588af37c935 req-bde5660a-5c96-4ab7-9c64-d63abe89e711 service nova] Acquiring lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:38.375494 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-aa1c07cf-2b39-4967-80e3-a588af37c935 req-bde5660a-5c96-4ab7-9c64-d63abe89e711 service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:38.375494 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-aa1c07cf-2b39-4967-80e3-a588af37c935 req-bde5660a-5c96-4ab7-9c64-d63abe89e711 service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:38.375494 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-aa1c07cf-2b39-4967-80e3-a588af37c935 req-bde5660a-5c96-4ab7-9c64-d63abe89e711 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] No waiting events found dispatching network-vif-plugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:15:38.375494 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-aa1c07cf-2b39-4967-80e3-a588af37c935 req-bde5660a-5c96-4ab7-9c64-d63abe89e711 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received unexpected event network-vif-plugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b for instance with vm_state active and task_state None. Jan 26 19:15:38.400407 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a05b0d9c-6d4a-4e61-ad39-8ca4d2c1b219 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 12.889s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:38.408269 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:15:38.412142 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:15:38.813982 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:39.562577 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-cf929140-5783-4dd9-8e7c-20b131462ef1 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:15:40.070603 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-cf929140-5783-4dd9-8e7c-20b131462ef1 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] instance snapshotting Jan 26 19:15:40.144948 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-cf929140-5783-4dd9-8e7c-20b131462ef1 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Beginning live snapshot process Jan 26 19:15:41.667356 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-cf929140-5783-4dd9-8e7c-20b131462ef1 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk --force-share --output=json -f qcow2 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:41.779414 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-cf929140-5783-4dd9-8e7c-20b131462ef1 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk --force-share --output=json -f qcow2" returned: 0 in 0.112s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:41.779869 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-cf929140-5783-4dd9-8e7c-20b131462ef1 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk --force-share --output=json -f qcow2 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:41.874053 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-cf929140-5783-4dd9-8e7c-20b131462ef1 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk --force-share --output=json -f qcow2" returned: 0 in 0.093s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:41.877994 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-cf929140-5783-4dd9-8e7c-20b131462ef1 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:15:41.880933 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-cf929140-5783-4dd9-8e7c-20b131462ef1 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:15:41.881286 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-cf929140-5783-4dd9-8e7c-20b131462ef1 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:41.952582 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-cf929140-5783-4dd9-8e7c-20b131462ef1 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.071s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:41.952946 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-cf929140-5783-4dd9-8e7c-20b131462ef1 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp33cgibsz/2377753e4b8c4ed995c8a041f8edca32.delta 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:42.000262 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-cf929140-5783-4dd9-8e7c-20b131462ef1 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp33cgibsz/2377753e4b8c4ed995c8a041f8edca32.delta 1073741824" returned: 0 in 0.047s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:42.000527 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-cf929140-5783-4dd9-8e7c-20b131462ef1 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Quiescing instance not available: QEMU guest agent is not enabled. Jan 26 19:15:42.053664 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-cf929140-5783-4dd9-8e7c-20b131462ef1 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=189076) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:845}} Jan 26 19:15:42.056813 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-cf929140-5783-4dd9-8e7c-20b131462ef1 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Skipping quiescing instance: QEMU guest agent is not enabled. Jan 26 19:15:42.082425 np0005596550.novalocal nova-compute[189076]: DEBUG nova.privsep.utils [None req-cf929140-5783-4dd9-8e7c-20b131462ef1 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=189076) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jan 26 19:15:42.082713 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-cf929140-5783-4dd9-8e7c-20b131462ef1 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp33cgibsz/2377753e4b8c4ed995c8a041f8edca32.delta /opt/stack/data/nova/instances/snapshots/tmp33cgibsz/2377753e4b8c4ed995c8a041f8edca32 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:42.281793 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-cf929140-5783-4dd9-8e7c-20b131462ef1 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp33cgibsz/2377753e4b8c4ed995c8a041f8edca32.delta /opt/stack/data/nova/instances/snapshots/tmp33cgibsz/2377753e4b8c4ed995c8a041f8edca32" returned: 0 in 0.199s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:42.282214 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-cf929140-5783-4dd9-8e7c-20b131462ef1 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Snapshot extracted, beginning image upload Jan 26 19:15:43.054823 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:43.686167 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:43.860635 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:44.583912 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-cf929140-5783-4dd9-8e7c-20b131462ef1 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Snapshot image upload complete Jan 26 19:15:44.584317 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-cf929140-5783-4dd9-8e7c-20b131462ef1 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Took 4.51 seconds to snapshot the instance on the hypervisor. Jan 26 19:15:46.475635 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Rescuing Jan 26 19:15:46.476071 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "refresh_cache-26e2c1ab-94b1-4731-afc4-9c987e187c8d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:15:46.476147 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquired lock "refresh_cache-26e2c1ab-94b1-4731-afc4-9c987e187c8d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:15:46.476442 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:15:46.984838 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:15:47.190098 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:15:47.319314 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Updating instance_info_cache with network_info: [{"id": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "address": "fa:16:3e:21:d5:2c", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd0122a-d9", "ovs_interfaceid": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:15:47.824726 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Releasing lock "refresh_cache-26e2c1ab-94b1-4731-afc4-9c987e187c8d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:15:48.056814 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:48.862568 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:49.431181 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:49.434071 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:49.435917 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:49.564095 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-2dfff0af-e7cc-4030-8f45-ae855756778e req-176d5b80-ca8d-4db7-b23a-2b681560c460 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received event network-vif-unplugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:15:49.564372 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2dfff0af-e7cc-4030-8f45-ae855756778e req-176d5b80-ca8d-4db7-b23a-2b681560c460 service nova] Acquiring lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:49.564636 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2dfff0af-e7cc-4030-8f45-ae855756778e req-176d5b80-ca8d-4db7-b23a-2b681560c460 service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:49.564841 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2dfff0af-e7cc-4030-8f45-ae855756778e req-176d5b80-ca8d-4db7-b23a-2b681560c460 service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:49.564986 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-2dfff0af-e7cc-4030-8f45-ae855756778e req-176d5b80-ca8d-4db7-b23a-2b681560c460 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] No waiting events found dispatching network-vif-unplugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:15:49.565149 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-2dfff0af-e7cc-4030-8f45-ae855756778e req-176d5b80-ca8d-4db7-b23a-2b681560c460 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received unexpected event network-vif-unplugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b for instance with vm_state active and task_state rescuing. Jan 26 19:15:49.585230 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:49.591412 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:49.628592 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:49.636463 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:49.690261 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Instance destroyed successfully. Jan 26 19:15:49.690688 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'numa_topology' on Instance uuid 26e2c1ab-94b1-4731-afc4-9c987e187c8d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:15:50.198560 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Attempting a stable device rescue Jan 26 19:15:50.286931 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'usb', 'dev': 'sda', 'type': 'disk'}}} {{(pid=189076) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4599}} Jan 26 19:15:50.290672 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Instance directory exists: not creating {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5157}} Jan 26 19:15:50.290969 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Creating image(s) Jan 26 19:15:50.291746 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "/opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:50.292057 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:50.292846 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:50.293114 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'trusted_certs' on Instance uuid 26e2c1ab-94b1-4731-afc4-9c987e187c8d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:15:50.795911 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<26e2c1ab-94b1-4731-afc4-9c987e187c8d> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:15:50.796177 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "c08e5e0fcf554a6a5f615e809b1ec1707094aed5" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:50.796562 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "c08e5e0fcf554a6a5f615e809b1ec1707094aed5" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:51.565709 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:15:51.570890 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:15:51.571326 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c08e5e0fcf554a6a5f615e809b1ec1707094aed5.part --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:51.655545 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c08e5e0fcf554a6a5f615e809b1ec1707094aed5.part --force-share --output=json" returned: 0 in 0.082s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:51.655545 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.images [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] a6c2bf43-4567-4955-9be7-3267efa93270 was qcow2, converting to raw {{(pid=189076) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jan 26 19:15:51.661231 np0005596550.novalocal nova-compute[189076]: DEBUG nova.privsep.utils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=189076) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jan 26 19:15:51.661231 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c08e5e0fcf554a6a5f615e809b1ec1707094aed5.part /opt/stack/data/nova/instances/_base/c08e5e0fcf554a6a5f615e809b1ec1707094aed5.converted {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:51.684594 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-37506bd6-b5fd-4514-be77-b2f75ec8b4fd req-f1e973d6-f7c3-4e48-9aca-66f5c2052e1b service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received event network-vif-unplugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:15:51.685090 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-37506bd6-b5fd-4514-be77-b2f75ec8b4fd req-f1e973d6-f7c3-4e48-9aca-66f5c2052e1b service nova] Acquiring lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:51.685532 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-37506bd6-b5fd-4514-be77-b2f75ec8b4fd req-f1e973d6-f7c3-4e48-9aca-66f5c2052e1b service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:51.685950 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-37506bd6-b5fd-4514-be77-b2f75ec8b4fd req-f1e973d6-f7c3-4e48-9aca-66f5c2052e1b service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:51.686261 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-37506bd6-b5fd-4514-be77-b2f75ec8b4fd req-f1e973d6-f7c3-4e48-9aca-66f5c2052e1b service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] No waiting events found dispatching network-vif-unplugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:15:51.686651 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-37506bd6-b5fd-4514-be77-b2f75ec8b4fd req-f1e973d6-f7c3-4e48-9aca-66f5c2052e1b service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received unexpected event network-vif-unplugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b for instance with vm_state active and task_state rescuing. Jan 26 19:15:51.789534 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c08e5e0fcf554a6a5f615e809b1ec1707094aed5.part /opt/stack/data/nova/instances/_base/c08e5e0fcf554a6a5f615e809b1ec1707094aed5.converted" returned: 0 in 0.129s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:51.796863 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c08e5e0fcf554a6a5f615e809b1ec1707094aed5.converted --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:51.885304 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c08e5e0fcf554a6a5f615e809b1ec1707094aed5.converted --force-share --output=json" returned: 0 in 0.088s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:51.886007 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "c08e5e0fcf554a6a5f615e809b1ec1707094aed5" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.089s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:51.886550 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:15:51.889447 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:15:51.890566 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "c08e5e0fcf554a6a5f615e809b1ec1707094aed5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:51.891003 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "c08e5e0fcf554a6a5f615e809b1ec1707094aed5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:51.891313 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:15:51.893792 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:15:51.894135 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c08e5e0fcf554a6a5f615e809b1ec1707094aed5 --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:51.972937 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c08e5e0fcf554a6a5f615e809b1ec1707094aed5 --force-share --output=json" returned: 0 in 0.078s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:51.974813 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c08e5e0fcf554a6a5f615e809b1ec1707094aed5,backing_fmt=raw /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk.rescue {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:52.022090 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c08e5e0fcf554a6a5f615e809b1ec1707094aed5,backing_fmt=raw /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk.rescue" returned: 0 in 0.048s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:52.022513 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "c08e5e0fcf554a6a5f615e809b1ec1707094aed5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.132s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:52.022958 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'migration_context' on Instance uuid 26e2c1ab-94b1-4731-afc4-9c987e187c8d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:15:52.527275 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<26e2c1ab-94b1-4731-afc4-9c987e187c8d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:15:52.527508 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:15:52.529362 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Start _get_guest_xml network_info=[{"id": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "address": "fa:16:3e:21:d5:2c", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "vif_mac": "fa:16:3e:21:d5:2c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd0122a-d9", "ovs_interfaceid": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'usb', 'dev': 'sda', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue={'image_id': 'a6c2bf43-4567-4955-9be7-3267efa93270', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:15:52.529594 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'resources' on Instance uuid 26e2c1ab-94b1-4731-afc4-9c987e187c8d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:15:53.033066 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<26e2c1ab-94b1-4731-afc4-9c987e187c8d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:15:53.040883 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:15:53.044629 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-844896935', uuid='26e2c1ab-94b1-4731-afc4-9c987e187c8d'), owner=OwnerMeta(userid='2724dd8bb624423083210013b9f090aa', username='tempest-ServerStableDeviceRescueTest-1891281471-project-member', projectid='819c3d68b8b1459bbf07574e4b01f715', projectname='tempest-ServerStableDeviceRescueTest-1891281471'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "address": "fa:16:3e:21:d5:2c", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "vif_mac": "fa:16:3e:21:d5:2c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd0122a-d9", "ovs_interfaceid": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472953.0437198) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:15:53.047050 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:15:53.047842 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:15:53.050113 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:15:53.050966 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:15:53.053018 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:15:53.053876 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:15:53.054400 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:15:53.054850 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:15:53.055313 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:15:53.055660 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:15:53.056281 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:15:53.056817 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:15:53.057224 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:15:53.057862 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:15:53.061949 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:15:53.061949 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:15:53.061949 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'vcpu_model' on Instance uuid 26e2c1ab-94b1-4731-afc4-9c987e187c8d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:15:53.062725 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:53.570793 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<26e2c1ab-94b1-4731-afc4-9c987e187c8d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:15:53.571245 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk.config --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:53.668845 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk.config --force-share --output=json" returned: 0 in 0.095s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:53.668845 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "/opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:53.668845 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:53.669858 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:53.672135 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-844896935',display_name='tempest-ServerStableDeviceRescueTest-server-844896935',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstabledevicerescuetest-server-844896935',id=94,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:15:37Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='819c3d68b8b1459bbf07574e4b01f715',ramdisk_id='',reservation_id='r-yocl0nfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1891281471',owner_user_name='tempest-ServerStableDeviceRescueTest-1891281471-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:15:44Z,user_data=None,user_id='2724dd8bb624423083210013b9f090aa',uuid=26e2c1ab-94b1-4731-afc4-9c987e187c8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "address": "fa:16:3e:21:d5:2c", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "vif_mac": "fa:16:3e:21:d5:2c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd0122a-d9", "ovs_interfaceid": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:15:53.672994 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converting VIF {"id": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "address": "fa:16:3e:21:d5:2c", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "vif_mac": "fa:16:3e:21:d5:2c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd0122a-d9", "ovs_interfaceid": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:15:53.674419 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:d5:2c,bridge_name='br-int',has_traffic_filtering=True,id=fdd0122a-d9ce-48b0-9f2c-156c89334d0b,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd0122a-d9') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:15:53.675611 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'pci_devices' on Instance uuid 26e2c1ab-94b1-4731-afc4-9c987e187c8d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:15:53.866219 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:54.183987 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<26e2c1ab-94b1-4731-afc4-9c987e187c8d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] End _get_guest_xml xml= Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: 26e2c1ab-94b1-4731-afc4-9c987e187c8d Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: instance-0000005e Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-server-844896935 Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:15:53 Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: ide Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: pc Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-1891281471-project-member Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-1891281471 Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: 26e2c1ab-94b1-4731-afc4-9c987e187c8d Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: 26e2c1ab-94b1-4731-afc4-9c987e187c8d Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: Jan 26 19:15:54.186339 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:15:54.198022 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Instance destroyed successfully. Jan 26 19:15:55.727592 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:15:55.727936 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:15:55.727936 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name sda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:15:55.728060 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No VIF found with MAC fa:16:3e:21:d5:2c, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:15:55.728725 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Using config drive Jan 26 19:15:56.236891 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'ec2_ids' on Instance uuid 26e2c1ab-94b1-4731-afc4-9c987e187c8d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:15:56.742037 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<26e2c1ab-94b1-4731-afc4-9c987e187c8d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:15:56.742665 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'keypairs' on Instance uuid 26e2c1ab-94b1-4731-afc4-9c987e187c8d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:15:57.246956 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<26e2c1ab-94b1-4731-afc4-9c987e187c8d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:15:57.251523 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:15:57.363045 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Creating config drive at /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk.config.rescue Jan 26 19:15:57.367388 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpz2mon42f {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:57.498649 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpz2mon42f" returned: 0 in 0.130s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:57.666160 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:57.679507 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:57.682863 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:57.821517 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:57.825725 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:57.854244 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for 26e2c1ab-94b1-4731-afc4-9c987e187c8d due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:15:57.854244 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:15:57.854244 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] VM Resumed (Lifecycle Event) Jan 26 19:15:57.860842 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a7f8c600-4875-451c-9be5-a52a6f0894bd tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:15:58.061785 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:58.360344 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:15:58.368979 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:15:58.753439 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-484c66cc-2426-4ad5-ae43-3fdba5612c1b req-1605b80b-c895-4221-8718-33e8169dd1a9 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received event network-vif-plugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:15:58.753668 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-484c66cc-2426-4ad5-ae43-3fdba5612c1b req-1605b80b-c895-4221-8718-33e8169dd1a9 service nova] Acquiring lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:15:58.754657 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-484c66cc-2426-4ad5-ae43-3fdba5612c1b req-1605b80b-c895-4221-8718-33e8169dd1a9 service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:15:58.754657 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-484c66cc-2426-4ad5-ae43-3fdba5612c1b req-1605b80b-c895-4221-8718-33e8169dd1a9 service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:15:58.755451 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-484c66cc-2426-4ad5-ae43-3fdba5612c1b req-1605b80b-c895-4221-8718-33e8169dd1a9 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] No waiting events found dispatching network-vif-plugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:15:58.756039 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-484c66cc-2426-4ad5-ae43-3fdba5612c1b req-1605b80b-c895-4221-8718-33e8169dd1a9 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received unexpected event network-vif-plugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b for instance with vm_state rescued and task_state unrescuing. Jan 26 19:15:58.867881 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:15:58.872982 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:15:58.872982 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] VM Started (Lifecycle Event) Jan 26 19:15:59.094898 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-cc8fd15d-54ef-48e8-982c-f1d14227cebc tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Unrescuing Jan 26 19:15:59.094898 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-cc8fd15d-54ef-48e8-982c-f1d14227cebc tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "refresh_cache-26e2c1ab-94b1-4731-afc4-9c987e187c8d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:15:59.094898 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-cc8fd15d-54ef-48e8-982c-f1d14227cebc tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquired lock "refresh_cache-26e2c1ab-94b1-4731-afc4-9c987e187c8d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:15:59.094898 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-cc8fd15d-54ef-48e8-982c-f1d14227cebc tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:15:59.376908 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:15:59.381413 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:15:59.598705 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-cc8fd15d-54ef-48e8-982c-f1d14227cebc tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:15:59.892399 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] During sync_power_state the instance has a pending task (unrescuing). Skip. Jan 26 19:15:59.925022 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-cc8fd15d-54ef-48e8-982c-f1d14227cebc tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:16:00.173887 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-cc8fd15d-54ef-48e8-982c-f1d14227cebc tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Updating instance_info_cache with network_info: [{"id": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "address": "fa:16:3e:21:d5:2c", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd0122a-d9", "ovs_interfaceid": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:16:00.679016 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-cc8fd15d-54ef-48e8-982c-f1d14227cebc tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Releasing lock "refresh_cache-26e2c1ab-94b1-4731-afc4-9c987e187c8d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:16:00.680777 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-cc8fd15d-54ef-48e8-982c-f1d14227cebc tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'flavor' on Instance uuid 26e2c1ab-94b1-4731-afc4-9c987e187c8d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:16:00.811673 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d4fcfc49-3aa0-488b-b624-1034d94728e8 req-397a6017-32bd-468c-a653-06ba1b048917 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received event network-vif-plugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:16:00.811934 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d4fcfc49-3aa0-488b-b624-1034d94728e8 req-397a6017-32bd-468c-a653-06ba1b048917 service nova] Acquiring lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:00.812159 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d4fcfc49-3aa0-488b-b624-1034d94728e8 req-397a6017-32bd-468c-a653-06ba1b048917 service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:00.812366 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d4fcfc49-3aa0-488b-b624-1034d94728e8 req-397a6017-32bd-468c-a653-06ba1b048917 service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:00.812545 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d4fcfc49-3aa0-488b-b624-1034d94728e8 req-397a6017-32bd-468c-a653-06ba1b048917 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] No waiting events found dispatching network-vif-plugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:16:00.812743 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-d4fcfc49-3aa0-488b-b624-1034d94728e8 req-397a6017-32bd-468c-a653-06ba1b048917 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received unexpected event network-vif-plugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b for instance with vm_state rescued and task_state unrescuing. Jan 26 19:16:01.221714 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:01.233338 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:01.422877 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:01.426605 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:01.439882 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:01.522240 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Instance destroyed successfully. Jan 26 19:16:01.523292 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-cc8fd15d-54ef-48e8-982c-f1d14227cebc tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'numa_topology' on Instance uuid 26e2c1ab-94b1-4731-afc4-9c987e187c8d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:16:02.026307 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-cc8fd15d-54ef-48e8-982c-f1d14227cebc tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<26e2c1ab-94b1-4731-afc4-9c987e187c8d> lazy-loaded attributes: flavor,numa_topology {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:16:02.114791 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:02.121717 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:02.141332 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:02.351420 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:02.352941 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:02.378264 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for 26e2c1ab-94b1-4731-afc4-9c987e187c8d due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:16:02.378493 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:16:02.378717 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] VM Resumed (Lifecycle Event) Jan 26 19:16:02.382656 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-cc8fd15d-54ef-48e8-982c-f1d14227cebc tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:16:02.884971 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:16:02.891745 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:16:02.904692 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received event network-vif-unplugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:16:02.904692 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] Acquiring lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:02.904692 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:02.904692 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:02.904692 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] No waiting events found dispatching network-vif-unplugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:16:02.904692 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received unexpected event network-vif-unplugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b for instance with vm_state active and task_state None. Jan 26 19:16:02.904692 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received event network-vif-unplugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:16:02.904692 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] Acquiring lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:02.904692 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:02.904692 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:02.904692 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] No waiting events found dispatching network-vif-unplugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:16:02.904972 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received unexpected event network-vif-unplugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b for instance with vm_state active and task_state None. Jan 26 19:16:02.905392 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received event network-vif-plugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:16:02.905392 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] Acquiring lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:02.905392 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:02.905529 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:02.905778 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] No waiting events found dispatching network-vif-plugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:16:02.905971 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received unexpected event network-vif-plugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b for instance with vm_state active and task_state None. Jan 26 19:16:02.906115 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received event network-vif-plugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:16:02.906244 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] Acquiring lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:02.906383 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:02.906503 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:02.906684 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] No waiting events found dispatching network-vif-plugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:16:02.906837 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-e8914e49-152c-43b6-a067-04c0b9feb392 req-6683241f-d0f8-43f4-bb04-a5ec2ae740c5 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received unexpected event network-vif-plugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b for instance with vm_state active and task_state None. Jan 26 19:16:03.064783 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:03.397156 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:16:03.397487 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] VM Started (Lifecycle Event) Jan 26 19:16:03.871726 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:03.901951 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:16:03.909756 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:16:04.591791 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "0832d494-61af-4cf9-86e6-3a0293b8f09d" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:04.591791 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:05.093831 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:16:05.632054 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:05.632674 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:05.634945 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:16:05.635134 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Claim successful on node np0005596550.novalocal Jan 26 19:16:06.841464 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:16:07.347408 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:16:07.853564 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.221s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:07.854155 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:16:08.066740 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:08.363338 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:16:08.363562 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:16:08.363900 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:16:08.364145 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:16:08.451062 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2724dd8bb624423083210013b9f090aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3d68b8b1459bbf07574e4b01f715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:16:08.864021 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:16:08.873670 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:08.988356 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Successfully created port: 8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:16:09.369795 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:16:09.448569 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Successfully updated port: 8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:16:09.481258 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-091fa628-b5f6-4462-aae5-95ed0dc08907 req-f5169968-c8c1-4234-b94f-c9eb93f626ba service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received event network-changed-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:16:09.481660 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-091fa628-b5f6-4462-aae5-95ed0dc08907 req-f5169968-c8c1-4234-b94f-c9eb93f626ba service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Refreshing instance network info cache due to event network-changed-8efef1f6-1c33-4112-a281-960b409908c8. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:16:09.481853 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-091fa628-b5f6-4462-aae5-95ed0dc08907 req-f5169968-c8c1-4234-b94f-c9eb93f626ba service nova] Acquiring lock "refresh_cache-0832d494-61af-4cf9-86e6-3a0293b8f09d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:16:09.481972 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-091fa628-b5f6-4462-aae5-95ed0dc08907 req-f5169968-c8c1-4234-b94f-c9eb93f626ba service nova] Acquired lock "refresh_cache-0832d494-61af-4cf9-86e6-3a0293b8f09d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:16:09.482101 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-091fa628-b5f6-4462-aae5-95ed0dc08907 req-f5169968-c8c1-4234-b94f-c9eb93f626ba service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Refreshing network info cache for port 8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:16:09.951962 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "refresh_cache-0832d494-61af-4cf9-86e6-3a0293b8f09d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:16:09.985438 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-091fa628-b5f6-4462-aae5-95ed0dc08907 req-f5169968-c8c1-4234-b94f-c9eb93f626ba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:16:10.050337 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-091fa628-b5f6-4462-aae5-95ed0dc08907 req-f5169968-c8c1-4234-b94f-c9eb93f626ba service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:16:10.166674 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-091fa628-b5f6-4462-aae5-95ed0dc08907 req-f5169968-c8c1-4234-b94f-c9eb93f626ba service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:16:10.378908 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:16:10.379805 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:16:10.380140 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Creating image(s) Jan 26 19:16:10.380566 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "/opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:10.380743 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:10.381266 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:10.382111 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:16:10.384884 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:16:10.385972 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:10.479297 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.093s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:10.479658 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:10.480085 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:10.480530 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:16:10.484179 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:16:10.484788 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:10.583166 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.098s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:10.583512 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:10.647403 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk 1073741824" returned: 0 in 0.063s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:10.647992 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.168s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:10.648291 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:10.669658 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-091fa628-b5f6-4462-aae5-95ed0dc08907 req-f5169968-c8c1-4234-b94f-c9eb93f626ba service nova] Releasing lock "refresh_cache-0832d494-61af-4cf9-86e6-3a0293b8f09d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:16:10.670213 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquired lock "refresh_cache-0832d494-61af-4cf9-86e6-3a0293b8f09d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:16:10.670410 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:16:10.717794 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.068s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:10.717794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:16:10.717794 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:10.784792 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk --force-share --output=json" returned: 0 in 0.067s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:10.784958 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Cannot resize image /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:16:10.785787 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:16:10.785787 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Ensure instance console log exists: /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:16:10.785787 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:10.785865 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:10.786028 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:11.240541 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:16:11.393808 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:16:11.533448 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Updating instance_info_cache with network_info: [{"id": "8efef1f6-1c33-4112-a281-960b409908c8", "address": "fa:16:3e:21:ab:44", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efef1f6-1c", "ovs_interfaceid": "8efef1f6-1c33-4112-a281-960b409908c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:16:12.039413 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Releasing lock "refresh_cache-0832d494-61af-4cf9-86e6-3a0293b8f09d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:16:12.039413 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Instance network_info: |[{"id": "8efef1f6-1c33-4112-a281-960b409908c8", "address": "fa:16:3e:21:ab:44", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efef1f6-1c", "ovs_interfaceid": "8efef1f6-1c33-4112-a281-960b409908c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:16:12.039413 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Start _get_guest_xml network_info=[{"id": "8efef1f6-1c33-4112-a281-960b409908c8", "address": "fa:16:3e:21:ab:44", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efef1f6-1c", "ovs_interfaceid": "8efef1f6-1c33-4112-a281-960b409908c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:16:12.045521 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:16:12.046930 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-239032308', uuid='0832d494-61af-4cf9-86e6-3a0293b8f09d'), owner=OwnerMeta(userid='2724dd8bb624423083210013b9f090aa', username='tempest-ServerStableDeviceRescueTest-1891281471-project-member', projectid='819c3d68b8b1459bbf07574e4b01f715', projectname='tempest-ServerStableDeviceRescueTest-1891281471'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8efef1f6-1c33-4112-a281-960b409908c8", "address": "fa:16:3e:21:ab:44", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efef1f6-1c", "ovs_interfaceid": "8efef1f6-1c33-4112-a281-960b409908c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472972.0465488) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:16:12.050453 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:16:12.050966 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:16:12.055858 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:16:12.055858 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:16:12.055858 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:16:12.056221 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:16:12.056564 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:16:12.056849 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:16:12.057059 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:16:12.057232 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:16:12.057447 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:16:12.057738 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:16:12.057971 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:16:12.058166 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:16:12.058416 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:16:12.058636 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:16:12.064054 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:16:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-239032308',display_name='tempest-ServerStableDeviceRescueTest-server-239032308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstabledevicerescuetest-server-239032308',id=95,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='819c3d68b8b1459bbf07574e4b01f715',ramdisk_id='',reservation_id='r-lrtvn96e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1891281471',owner_user_name='tempest-ServerStableDeviceRescueTest-1891281471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:16:09Z,user_data=None,user_id='2724dd8bb624423083210013b9f090aa',uuid=0832d494-61af-4cf9-86e6-3a0293b8f09d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8efef1f6-1c33-4112-a281-960b409908c8", "address": "fa:16:3e:21:ab:44", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efef1f6-1c", "ovs_interfaceid": "8efef1f6-1c33-4112-a281-960b409908c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:16:12.064411 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converting VIF {"id": "8efef1f6-1c33-4112-a281-960b409908c8", "address": "fa:16:3e:21:ab:44", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efef1f6-1c", "ovs_interfaceid": "8efef1f6-1c33-4112-a281-960b409908c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:16:12.065308 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:ab:44,bridge_name='br-int',has_traffic_filtering=True,id=8efef1f6-1c33-4112-a281-960b409908c8,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8efef1f6-1c') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:16:12.067051 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'pci_devices' on Instance uuid 0832d494-61af-4cf9-86e6-3a0293b8f09d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] End _get_guest_xml xml= Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: 0832d494-61af-4cf9-86e6-3a0293b8f09d Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: instance-0000005f Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-server-239032308 Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:16:12 Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-1891281471-project-member Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-1891281471 Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: 0832d494-61af-4cf9-86e6-3a0293b8f09d Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: 0832d494-61af-4cf9-86e6-3a0293b8f09d Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Preparing to wait for external event network-vif-plugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:12.574846 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:12.577153 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:12.579368 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:16:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-239032308',display_name='tempest-ServerStableDeviceRescueTest-server-239032308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstabledevicerescuetest-server-239032308',id=95,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='819c3d68b8b1459bbf07574e4b01f715',ramdisk_id='',reservation_id='r-lrtvn96e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1891281471',owner_user_name='tempest-ServerStableDeviceRescueTest-1891281471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:16:09Z,user_data=None,user_id='2724dd8bb624423083210013b9f090aa',uuid=0832d494-61af-4cf9-86e6-3a0293b8f09d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8efef1f6-1c33-4112-a281-960b409908c8", "address": "fa:16:3e:21:ab:44", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efef1f6-1c", "ovs_interfaceid": "8efef1f6-1c33-4112-a281-960b409908c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:16:12.579368 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converting VIF {"id": "8efef1f6-1c33-4112-a281-960b409908c8", "address": "fa:16:3e:21:ab:44", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efef1f6-1c", "ovs_interfaceid": "8efef1f6-1c33-4112-a281-960b409908c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:16:12.579368 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:ab:44,bridge_name='br-int',has_traffic_filtering=True,id=8efef1f6-1c33-4112-a281-960b409908c8,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8efef1f6-1c') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:16:12.579781 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:ab:44,bridge_name='br-int',has_traffic_filtering=True,id=8efef1f6-1c33-4112-a281-960b409908c8,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8efef1f6-1c') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:16:12.580320 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:12.580668 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:16:12.581049 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:16:12.581726 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:12.582023 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '914676cc-2f0b-58c3-8189-f7d08eaafc5f', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:16:12.627875 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:12.629634 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:16:12.630829 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:12.634364 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:12.634651 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8efef1f6-1c, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:16:12.635043 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8efef1f6-1c, col_values=(('qos', UUID('ccfb3fbc-e096-41b6-ae59-4e1f65c9f36e')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:16:12.635266 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8efef1f6-1c, col_values=(('external_ids', {'iface-id': '8efef1f6-1c33-4112-a281-960b409908c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:ab:44', 'vm-uuid': '0832d494-61af-4cf9-86e6-3a0293b8f09d'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:16:12.636304 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:12.638715 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:16:12.644128 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:12.645157 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:ab:44,bridge_name='br-int',has_traffic_filtering=True,id=8efef1f6-1c33-4112-a281-960b409908c8,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8efef1f6-1c') Jan 26 19:16:13.070655 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:14.167207 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:16:14.167207 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:16:14.167207 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No VIF found with MAC fa:16:3e:21:ab:44, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:16:14.167207 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Using config drive Jan 26 19:16:14.678814 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:16:14.785790 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Creating config drive at /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk.config Jan 26 19:16:14.788148 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpmpqri96t {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:14.917533 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpmpqri96t" returned: 0 in 0.129s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:14.988266 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:14.999929 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:15.141995 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:15.164558 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-54423fb3-344a-46da-b47a-62e364e7fdc8 req-e7f7554e-db9e-45a1-83a2-805c78d0da3b service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received event network-vif-plugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:16:15.164703 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-54423fb3-344a-46da-b47a-62e364e7fdc8 req-e7f7554e-db9e-45a1-83a2-805c78d0da3b service nova] Acquiring lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:15.165180 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-54423fb3-344a-46da-b47a-62e364e7fdc8 req-e7f7554e-db9e-45a1-83a2-805c78d0da3b service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:15.165336 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-54423fb3-344a-46da-b47a-62e364e7fdc8 req-e7f7554e-db9e-45a1-83a2-805c78d0da3b service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:15.165491 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-54423fb3-344a-46da-b47a-62e364e7fdc8 req-e7f7554e-db9e-45a1-83a2-805c78d0da3b service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Processing event network-vif-plugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:16:15.191007 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:16:15.191266 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] VM Started (Lifecycle Event) Jan 26 19:16:15.192749 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:16:15.201208 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:16:15.212406 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Instance spawned successfully. Jan 26 19:16:15.212716 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:16:15.696150 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:16:15.699369 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:16:15.724176 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:16:15.724395 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:16:15.724995 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:16:15.725386 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:16:15.726097 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:16:15.726520 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:16:16.202859 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:16:16.203279 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:16:16.203279 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] VM Paused (Lifecycle Event) Jan 26 19:16:16.234674 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Took 5.86 seconds to spawn the instance on the hypervisor. Jan 26 19:16:16.234674 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:16:16.706469 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:16:16.708463 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:16:16.708604 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] VM Resumed (Lifecycle Event) Jan 26 19:16:16.745759 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Took 11.15 seconds to build instance. Jan 26 19:16:17.205615 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-19963fd2-d08a-487a-b837-5787607e41e8 req-f7ae7395-818e-45bd-a0cc-c9bc165105d9 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received event network-vif-plugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:16:17.207933 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-19963fd2-d08a-487a-b837-5787607e41e8 req-f7ae7395-818e-45bd-a0cc-c9bc165105d9 service nova] Acquiring lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:17.207933 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-19963fd2-d08a-487a-b837-5787607e41e8 req-f7ae7395-818e-45bd-a0cc-c9bc165105d9 service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:17.207933 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-19963fd2-d08a-487a-b837-5787607e41e8 req-f7ae7395-818e-45bd-a0cc-c9bc165105d9 service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:17.207933 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-19963fd2-d08a-487a-b837-5787607e41e8 req-f7ae7395-818e-45bd-a0cc-c9bc165105d9 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] No waiting events found dispatching network-vif-plugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:16:17.207933 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-19963fd2-d08a-487a-b837-5787607e41e8 req-f7ae7395-818e-45bd-a0cc-c9bc165105d9 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received unexpected event network-vif-plugged-8efef1f6-1c33-4112-a281-960b409908c8 for instance with vm_state active and task_state None. Jan 26 19:16:17.213364 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:16:17.221505 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:16:17.248070 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c8edb1c9-cb84-4dc2-bfb7-0e0cc6beb18f tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 12.657s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:17.640696 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:18.073649 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:18.651848 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-fbc07be7-f55f-4ed7-a2a8-a3ebc98a80ff tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:16:19.165703 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-fbc07be7-f55f-4ed7-a2a8-a3ebc98a80ff tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] instance snapshotting Jan 26 19:16:19.241142 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-fbc07be7-f55f-4ed7-a2a8-a3ebc98a80ff tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Beginning live snapshot process Jan 26 19:16:20.770826 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fbc07be7-f55f-4ed7-a2a8-a3ebc98a80ff tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk --force-share --output=json -f qcow2 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:20.897024 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:16:20.898834 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fbc07be7-f55f-4ed7-a2a8-a3ebc98a80ff tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk --force-share --output=json -f qcow2" returned: 0 in 0.128s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:20.903101 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fbc07be7-f55f-4ed7-a2a8-a3ebc98a80ff tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk --force-share --output=json -f qcow2 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:21.024551 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fbc07be7-f55f-4ed7-a2a8-a3ebc98a80ff tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk --force-share --output=json -f qcow2" returned: 0 in 0.123s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:21.025305 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-fbc07be7-f55f-4ed7-a2a8-a3ebc98a80ff tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:16:21.028206 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-fbc07be7-f55f-4ed7-a2a8-a3ebc98a80ff tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:16:21.028524 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fbc07be7-f55f-4ed7-a2a8-a3ebc98a80ff tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:21.135499 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fbc07be7-f55f-4ed7-a2a8-a3ebc98a80ff tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.107s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:21.135979 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fbc07be7-f55f-4ed7-a2a8-a3ebc98a80ff tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjvckvrqr/270fbd4fd8394296bdcda77699a111ca.delta 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:21.175517 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fbc07be7-f55f-4ed7-a2a8-a3ebc98a80ff tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjvckvrqr/270fbd4fd8394296bdcda77699a111ca.delta 1073741824" returned: 0 in 0.039s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:21.176047 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-fbc07be7-f55f-4ed7-a2a8-a3ebc98a80ff tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Quiescing instance not available: QEMU guest agent is not enabled. Jan 26 19:16:21.254135 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-fbc07be7-f55f-4ed7-a2a8-a3ebc98a80ff tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=189076) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:845}} Jan 26 19:16:21.256733 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-fbc07be7-f55f-4ed7-a2a8-a3ebc98a80ff tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Skipping quiescing instance: QEMU guest agent is not enabled. Jan 26 19:16:21.337580 np0005596550.novalocal nova-compute[189076]: DEBUG nova.privsep.utils [None req-fbc07be7-f55f-4ed7-a2a8-a3ebc98a80ff tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=189076) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jan 26 19:16:21.337876 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fbc07be7-f55f-4ed7-a2a8-a3ebc98a80ff tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjvckvrqr/270fbd4fd8394296bdcda77699a111ca.delta /opt/stack/data/nova/instances/snapshots/tmpjvckvrqr/270fbd4fd8394296bdcda77699a111ca {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:21.443329 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:21.443629 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:21.445941 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:21.446195 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:16:21.545051 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fbc07be7-f55f-4ed7-a2a8-a3ebc98a80ff tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjvckvrqr/270fbd4fd8394296bdcda77699a111ca.delta /opt/stack/data/nova/instances/snapshots/tmpjvckvrqr/270fbd4fd8394296bdcda77699a111ca" returned: 0 in 0.207s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:21.547028 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-fbc07be7-f55f-4ed7-a2a8-a3ebc98a80ff tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Snapshot extracted, beginning image upload Jan 26 19:16:22.500402 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:22.599732 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:22.599732 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:22.672267 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:22.694908 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:22.707023 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dba4cc-3bec-479a-9c7a-f656b5b91386/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:22.812222 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dba4cc-3bec-479a-9c7a-f656b5b91386/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:22.812703 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dba4cc-3bec-479a-9c7a-f656b5b91386/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:22.949393 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dba4cc-3bec-479a-9c7a-f656b5b91386/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:22.950098 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] skipping disk /dev/sda (vdb) as it is a volume {{(pid=189076) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12209}} Jan 26 19:16:22.956024 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:23.062235 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:23.062235 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:23.086233 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:23.205218 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:23.220409 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:23.367746 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:23.369827 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:23.451482 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:23.649905 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:16:23.649905 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:23.670843 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.020s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:23.671626 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=6616MB free_disk=372.80429458618164GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:16:23.671927 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:23.672219 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:24.398297 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "62dba4cc-3bec-479a-9c7a-f656b5b91386" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:24.398692 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "62dba4cc-3bec-479a-9c7a-f656b5b91386" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:24.747984 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 62dba4cc-3bec-479a-9c7a-f656b5b91386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:16:24.747984 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 4b54d0fc-613e-4ce1-8ba9-54651f4079bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:16:24.747984 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 26e2c1ab-94b1-4731-afc4-9c987e187c8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:16:24.747984 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 0832d494-61af-4cf9-86e6-3a0293b8f09d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:16:24.747984 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 4 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:16:24.747984 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=1280MB phys_disk=399GB used_disk=4GB total_vcpus=8 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:16:23 up 44 min, 13 users, load average: 5.89, 5.03, 4.36\n', 'num_instances': '4', 'num_vm_active': '4', 'num_task_None': '3', 'num_os_type_None': '4', 'num_proj_261cb1c98c954302ba86efa2ceee43f2': '1', 'io_workload': '0', 'num_proj_819c3d68b8b1459bbf07574e4b01f715': '3', 'num_task_image_uploading': '1'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:16:24.812594 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-fbc07be7-f55f-4ed7-a2a8-a3ebc98a80ff tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Snapshot image upload complete Jan 26 19:16:24.812944 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-fbc07be7-f55f-4ed7-a2a8-a3ebc98a80ff tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Took 5.65 seconds to snapshot the instance on the hypervisor. Jan 26 19:16:24.903636 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Detaching volume d438bc89-fce8-47ba-bf8f-fd79987670fc Jan 26 19:16:24.923017 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:16:24.960402 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.block_device [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Attempting to driver detach volume d438bc89-fce8-47ba-bf8f-fd79987670fc from mountpoint /dev/vdb Jan 26 19:16:24.970942 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Found disk vdb by alias ua-d438bc89-fce8-47ba-bf8f-fd79987670fc {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:16:24.972356 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Found disk vdb by alias ua-d438bc89-fce8-47ba-bf8f-fd79987670fc {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:16:24.972498 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Attempting to detach device vdb from instance 62dba4cc-3bec-479a-9c7a-f656b5b91386 from the persistent domain config. {{(pid=189076) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2599}} Jan 26 19:16:24.972890 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] detach device xml: Jan 26 19:16:24.972890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:24.972890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:24.972890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:24.972890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:24.972890 np0005596550.novalocal nova-compute[189076]: d438bc89-fce8-47ba-bf8f-fd79987670fc Jan 26 19:16:24.972890 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:16:24.972890 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:24.972890 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:16:24.984731 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Found disk vdb by alias ua-d438bc89-fce8-47ba-bf8f-fd79987670fc {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:16:24.984862 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Failed to detach device vdb from instance 62dba4cc-3bec-479a-9c7a-f656b5b91386 from the persistent domain config. Libvirt did not report any error but the device is still in the config. Jan 26 19:16:24.985041 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] (1/8): Attempting to detach device vdb with device alias ua-d438bc89-fce8-47ba-bf8f-fd79987670fc from instance 62dba4cc-3bec-479a-9c7a-f656b5b91386 from the live domain config. {{(pid=189076) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2633}} Jan 26 19:16:24.985378 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] detach device xml: Jan 26 19:16:24.985378 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:24.985378 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:24.985378 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:24.985378 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:24.985378 np0005596550.novalocal nova-compute[189076]: d438bc89-fce8-47ba-bf8f-fd79987670fc Jan 26 19:16:24.985378 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:16:24.985378 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:24.985378 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:16:25.127642 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Received event ua-d438bc89-fce8-47ba-bf8f-fd79987670fc> from libvirt while the driver is waiting for it; dispatched. {{(pid=189076) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2486}} Jan 26 19:16:25.128523 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d438bc89-fce8-47ba-bf8f-fd79987670fc for instance 62dba4cc-3bec-479a-9c7a-f656b5b91386 {{(pid=189076) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2713}} Jan 26 19:16:25.132600 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Successfully detached device vdb from instance 62dba4cc-3bec-479a-9c7a-f656b5b91386 from the live domain config. Jan 26 19:16:25.134990 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] calling os-brick to detach iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jan 26 19:16:25.136463 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc', 'target_lun': 0, 'volume_id': 'd438bc89-fce8-47ba-bf8f-fd79987670fc', 'auth_method': 'CHAP', 'auth_username': 'MZ4Dn2rVMJZW8cBoWJ6w', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sda'}, None), 'kwargs': False}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:16:25.136931 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:16:25.137577 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:16:25.139151 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:25.152231 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:25.154574 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd6fb63-0683-42b4-98a7-6b47d8f65457]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:25.154924 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:16:25.154924 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:16:25.154924 np0005596550.novalocal nova-compute[189076]: iSNS: Jan 26 19:16:25.154924 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:16:25.154924 np0005596550.novalocal nova-compute[189076]: STATIC: Jan 26 19:16:25.154924 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc Jan 26 19:16:25.154924 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:16:25.154924 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:16:25.154924 np0005596550.novalocal nova-compute[189076]: FIRMWARE: Jan 26 19:16:25.154924 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:16:25.154924 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:16:25.155238 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:16:25.155238 np0005596550.novalocal nova-compute[189076]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:16:25.155238 np0005596550.novalocal nova-compute[189076]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=189076) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:16:25.155344 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc', 0)] {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:16:25.156494 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:25.172960 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:25.173223 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7334dc2-39f7-4156-8c81-90eacc7c73a9]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:25.175160 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:25.194989 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:25.195327 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[34086224-af96-42fc-92ac-8608a6b74ed5]: (4, ('tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:25.195978 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash) Jan 26 19:16:25.195978 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:16:25.196293 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsi session list stdout=tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash) Jan 26 19:16:25.196293 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:16:25.197550 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Resulting device map defaultdict(. at 0x7fd7506447c0>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc'): ({'sda'}, set())}) {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:16:25.198084 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Removing single pathed devices sda {{(pid=189076) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:16:25.199185 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:25.210954 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:16:25.213991 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[5edb7d6e-5437-49f9-b9f7-ff73f3453cca]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:16:25.213991 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:16:25.213991 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:16:25.213991 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:16:25.213991 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:25.213991 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:16:25.213991 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:16:25.213991 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:25.213991 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:16:25.213991 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:16:25.213991 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:25.213991 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:16:25.213991 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:16:25.213991 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:25.213991 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:16:25.213991 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:16:25.213991 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:25.213991 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:16:25.213991 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:16:25.213991 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:16:25.213991 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:16:25.213991 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:16:25.215367 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edb7d6e-5437-49f9-b9f7-ff73f3453cca]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:25.216366 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Flushing IO for device /dev/sda {{(pid=189076) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:16:25.219123 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sda {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:25.229837 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sda" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:25.230591 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd03a2d1-2302-421f-ba42-52a019656066]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:25.231232 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Remove SCSI device /dev/sda with /sys/block/sda/device/delete {{(pid=189076) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:16:25.233315 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sda/device/delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:25.284422 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sda/device/delete" returned: 0 in 0.051s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:25.284625 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bbd679-7d0f-4dc4-b5fb-3507840f5bdb]: (4, ('1', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:25.285230 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Checking to see if SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:16:25.285306 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:16:25.285613 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc')] {{(pid=189076) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:16:25.287152 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:25.302189 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.014s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:25.302386 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f33ea0-2f7d-420f-8612-16b6c8d573bc]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:25.302749 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:16:25.303737 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260 --logout {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:25.336722 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260 --logout" returned: 0 in 0.033s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:25.336902 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d774102a-84e6-4e48-8ab4-da840075a5ac]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc, portal: 38.102.83.18,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:25.337219 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc, portal: 38.102.83.18,3260] Jan 26 19:16:25.337219 np0005596550.novalocal nova-compute[189076]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc, portal: 38.102.83.18,3260] successful. Jan 26 19:16:25.337219 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:16:25.337852 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260 --op delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:25.354581 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc -p 38.102.83.18:3260 --op delete" returned: 0 in 0.016s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:25.354718 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac768a31-5693-42a2-90a1-2135ef5b9d84]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:25.355123 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:16:25.355467 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.218s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:16:25.355690 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] <== disconnect_volume: return (218ms) None {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:16:25.356040 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Disconnected iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jan 26 19:16:25.426907 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:16:25.937900 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:16:25.938472 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.266s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:26.824657 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Rescuing Jan 26 19:16:26.825061 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "refresh_cache-0832d494-61af-4cf9-86e6-3a0293b8f09d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:16:26.826063 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquired lock "refresh_cache-0832d494-61af-4cf9-86e6-3a0293b8f09d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:16:26.826063 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:16:26.938866 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:16:26.938866 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:16:26.938866 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:16:27.332405 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:16:27.623456 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:16:27.730274 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:27.809478 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Updating instance_info_cache with network_info: [{"id": "8efef1f6-1c33-4112-a281-960b409908c8", "address": "fa:16:3e:21:ab:44", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efef1f6-1c", "ovs_interfaceid": "8efef1f6-1c33-4112-a281-960b409908c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:16:28.078218 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:28.312594 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Releasing lock "refresh_cache-0832d494-61af-4cf9-86e6-3a0293b8f09d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:16:28.899760 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:16:28.904471 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:16:28.960312 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lazy-loading 'flavor' on Instance uuid 62dba4cc-3bec-479a-9c7a-f656b5b91386 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:16:29.831418 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "62dba4cc-3bec-479a-9c7a-f656b5b91386" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:29.895840 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:16:29.895840 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:16:29.896091 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:16:29.972383 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:29.976863 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3e0c108d-6f1d-438c-8073-04164582ad4d tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "62dba4cc-3bec-479a-9c7a-f656b5b91386" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 5.578s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:29.981220 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "62dba4cc-3bec-479a-9c7a-f656b5b91386" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.150s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:29.981220 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "62dba4cc-3bec-479a-9c7a-f656b5b91386-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:29.982053 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "62dba4cc-3bec-479a-9c7a-f656b5b91386-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:29.982366 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "62dba4cc-3bec-479a-9c7a-f656b5b91386-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:29.984824 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Terminating instance Jan 26 19:16:30.121971 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-2310f093-4473-4708-8436-a738314a0444 req-085a473d-5151-424e-8be8-beccf655a9fb service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received event network-vif-unplugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:16:30.122739 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2310f093-4473-4708-8436-a738314a0444 req-085a473d-5151-424e-8be8-beccf655a9fb service nova] Acquiring lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:30.124265 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2310f093-4473-4708-8436-a738314a0444 req-085a473d-5151-424e-8be8-beccf655a9fb service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:30.124696 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2310f093-4473-4708-8436-a738314a0444 req-085a473d-5151-424e-8be8-beccf655a9fb service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:30.125208 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-2310f093-4473-4708-8436-a738314a0444 req-085a473d-5151-424e-8be8-beccf655a9fb service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] No waiting events found dispatching network-vif-unplugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:16:30.125676 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-2310f093-4473-4708-8436-a738314a0444 req-085a473d-5151-424e-8be8-beccf655a9fb service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received unexpected event network-vif-unplugged-8efef1f6-1c33-4112-a281-960b409908c8 for instance with vm_state active and task_state rescuing. Jan 26 19:16:30.153802 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:30.161677 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:30.241373 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Instance destroyed successfully. Jan 26 19:16:30.241835 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'numa_topology' on Instance uuid 0832d494-61af-4cf9-86e6-3a0293b8f09d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:16:30.530205 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:16:30.557670 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:30.584951 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:30.605430 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:30.693122 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a340f8bc-7631-4f12-9755-47d7d205e807 req-c26be76f-0685-4421-898f-b463191b4e5b service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Received event network-vif-unplugged-337720a2-10c1-4f42-ab4f-23bb29c7f627 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:16:30.693366 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a340f8bc-7631-4f12-9755-47d7d205e807 req-c26be76f-0685-4421-898f-b463191b4e5b service nova] Acquiring lock "62dba4cc-3bec-479a-9c7a-f656b5b91386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:30.695910 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a340f8bc-7631-4f12-9755-47d7d205e807 req-c26be76f-0685-4421-898f-b463191b4e5b service nova] Lock "62dba4cc-3bec-479a-9c7a-f656b5b91386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:30.696046 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a340f8bc-7631-4f12-9755-47d7d205e807 req-c26be76f-0685-4421-898f-b463191b4e5b service nova] Lock "62dba4cc-3bec-479a-9c7a-f656b5b91386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:30.696192 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a340f8bc-7631-4f12-9755-47d7d205e807 req-c26be76f-0685-4421-898f-b463191b4e5b service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] No waiting events found dispatching network-vif-unplugged-337720a2-10c1-4f42-ab4f-23bb29c7f627 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:16:30.696357 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a340f8bc-7631-4f12-9755-47d7d205e807 req-c26be76f-0685-4421-898f-b463191b4e5b service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Received event network-vif-unplugged-337720a2-10c1-4f42-ab4f-23bb29c7f627 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:16:30.753860 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Attempting a stable device rescue Jan 26 19:16:30.824637 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=189076) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4599}} Jan 26 19:16:30.825048 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Instance destroyed successfully. Jan 26 19:16:30.825558 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lazy-loading 'resources' on Instance uuid 62dba4cc-3bec-479a-9c7a-f656b5b91386 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:16:30.829157 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Instance directory exists: not creating {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5157}} Jan 26 19:16:30.829301 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Creating image(s) Jan 26 19:16:30.829932 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "/opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:30.830210 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:30.830702 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:30.830885 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0832d494-61af-4cf9-86e6-3a0293b8f09d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:16:31.330029 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:14:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1088358399',display_name='tempest-VolumesBackupsTest-instance-1088358399',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-volumesbackupstest-instance-1088358399',id=92,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOl0KIECtw/lnzJQ7soiCWj5snZsufKRgMYqFq/buu5oOilMG2vAkjBybaPMVU1Vgq8sPBnV7yCucLSBYDy/Z2wEN1HGEWTImDBA0r9R9l2hj6Mpq/neqRvUNssXu77lg==',key_name='tempest-keypair-519673318',keypairs=,launch_index=0,launched_at=2026-01-27T00:14:25Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='261cb1c98c954302ba86efa2ceee43f2',ramdisk_id='',reservation_id='r-5e0lzoym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-97611117',owner_user_name='tempest-VolumesBackupsTest-97611117-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:14:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6cbe3740f6c4303bbf3e5d5c92677db',uuid=62dba4cc-3bec-479a-9c7a-f656b5b91386,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "337720a2-10c1-4f42-ab4f-23bb29c7f627", "address": "fa:16:3e:eb:a5:8e", "network": {"id": "94b85e06-699e-4d2b-a361-6a62d99d858f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1614914474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261cb1c98c954302ba86efa2ceee43f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap337720a2-10", "ovs_interfaceid": "337720a2-10c1-4f42-ab4f-23bb29c7f627", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:16:31.330814 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Converting VIF {"id": "337720a2-10c1-4f42-ab4f-23bb29c7f627", "address": "fa:16:3e:eb:a5:8e", "network": {"id": "94b85e06-699e-4d2b-a361-6a62d99d858f", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1614914474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "261cb1c98c954302ba86efa2ceee43f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap337720a2-10", "ovs_interfaceid": "337720a2-10c1-4f42-ab4f-23bb29c7f627", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:16:31.331553 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:a5:8e,bridge_name='br-int',has_traffic_filtering=True,id=337720a2-10c1-4f42-ab4f-23bb29c7f627,network=Network(94b85e06-699e-4d2b-a361-6a62d99d858f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap337720a2-10') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:16:31.332076 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:a5:8e,bridge_name='br-int',has_traffic_filtering=True,id=337720a2-10c1-4f42-ab4f-23bb29c7f627,network=Network(94b85e06-699e-4d2b-a361-6a62d99d858f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap337720a2-10') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:16:31.335172 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<0832d494-61af-4cf9-86e6-3a0293b8f09d> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:16:31.335654 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "5359100dcec0f3930af3752a640f2217ee2a6cef" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:31.336361 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "5359100dcec0f3930af3752a640f2217ee2a6cef" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:31.355077 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:31.355411 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap337720a2-10, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:16:31.356941 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:31.360523 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:16:31.368920 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:31.370230 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:31.370591 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=909620d4-64f6-4143-b0c3-3b3aa5132632) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:16:31.371443 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:31.374312 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:16:31.383842 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:31.386542 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:a5:8e,bridge_name='br-int',has_traffic_filtering=True,id=337720a2-10c1-4f42-ab4f-23bb29c7f627,network=Network(94b85e06-699e-4d2b-a361-6a62d99d858f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap337720a2-10') Jan 26 19:16:31.393690 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] calling os-brick to detach iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jan 26 19:16:31.393690 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc', 'target_lun': 0, 'volume_id': 'd438bc89-fce8-47ba-bf8f-fd79987670fc', 'auth_method': 'CHAP', 'auth_username': 'MZ4Dn2rVMJZW8cBoWJ6w', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sda'}, None), 'kwargs': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:16:31.393690 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:16:31.393690 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:16:31.398524 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:31.419575 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:31.419961 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[4557b34b-067f-483d-b387-d6418f8e649b]: Unexpected error while running command. Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: Command: iscsiadm -m discoverydb -o show -P 1 Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: Exit code: 21 Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n' Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: Stderr: '' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 388, in execute Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: raise ProcessExecutionError(exit_code=_returncode, Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command. Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: Command: iscsiadm -m discoverydb -o show -P 1 Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: Exit code: 21 Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n' Jan 26 19:16:31.420176 np0005596550.novalocal nova-compute[189076]: Stderr: '' Jan 26 19:16:31.420837 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4557b34b-067f-483d-b387-d6418f8e649b]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 388, in execute\n raise ProcessExecutionError(exit_code=_returncode,\noslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.\nCommand: iscsiadm -m discoverydb -o show -P 1\nExit code: 21\nStdout: \'SENDTARGETS:\\nNo targets found.\\niSNS:\\nNo targets found.\\nSTATIC:\\nNo targets found.\\nFIRMWARE:\\nNo targets found.\\n\'\nStderr: \'\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command. Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: Command: iscsiadm -m discoverydb -o show -P 1 Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: Exit code: 21 Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n' Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: Stderr: '' Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last): Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py", line 227, in _get_ips_iqns_luns Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ips_iqns_luns = method(connection_properties) Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py", line 386, in _get_discoverydb_portals Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi out = self._run_iscsiadm_bare(['-m', 'discoverydb', Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py", line 1218, in _run_iscsiadm_bare Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi (out, err) = self._execute('iscsiadm', Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/os_brick/executor.py", line 55, in _execute Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi result = self.__execute(*args, **kwargs) Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 173, in execute Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi return execute_root(*cmd, **kwargs) Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 267, in _wrap Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi return self.channel.remote_call(name, args, kwargs, Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 230, in remote_call Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi raise exc_type(*result[2]) Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command. Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1 Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21 Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n' Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Stderr: '' Jan 26 19:16:31.422397 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.iscsi Jan 26 19:16:31.423255 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Skipping cleanup Unable to find target portal 38.102.83.18:3260. {{(pid=189076) _cleanup_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:959}} Jan 26 19:16:31.423604 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.030s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:16:31.423881 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] <== disconnect_volume: return (31ms) None {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:16:31.424140 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Disconnected iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jan 26 19:16:31.424559 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Deleting instance files /opt/stack/data/nova/instances/62dba4cc-3bec-479a-9c7a-f656b5b91386_del Jan 26 19:16:31.425442 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Deletion of /opt/stack/data/nova/instances/62dba4cc-3bec-479a-9c7a-f656b5b91386_del complete Jan 26 19:16:31.959136 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Took 1.43 seconds to destroy the instance on the hypervisor. Jan 26 19:16:31.959381 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:16:31.959523 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:16:31.959605 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:16:31.959841 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:16:32.008328 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:16:32.010837 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:16:32.011116 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5359100dcec0f3930af3752a640f2217ee2a6cef.part --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:32.044213 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:16:32.102227 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5359100dcec0f3930af3752a640f2217ee2a6cef.part --force-share --output=json" returned: 0 in 0.091s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:32.102757 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.images [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] 21106f15-7aa4-4230-9ef0-a719af9a001e was qcow2, converting to raw {{(pid=189076) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jan 26 19:16:32.107212 np0005596550.novalocal nova-compute[189076]: DEBUG nova.privsep.utils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=189076) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jan 26 19:16:32.107212 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5359100dcec0f3930af3752a640f2217ee2a6cef.part /opt/stack/data/nova/instances/_base/5359100dcec0f3930af3752a640f2217ee2a6cef.converted {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:32.180324 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d3bd04ad-7f18-4333-8a1c-bc41d0aa9bc8 req-cabc29c2-bb70-460a-8bab-b09c36c073ee service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received event network-vif-unplugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:16:32.180884 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d3bd04ad-7f18-4333-8a1c-bc41d0aa9bc8 req-cabc29c2-bb70-460a-8bab-b09c36c073ee service nova] Acquiring lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:32.181282 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d3bd04ad-7f18-4333-8a1c-bc41d0aa9bc8 req-cabc29c2-bb70-460a-8bab-b09c36c073ee service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:32.181576 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d3bd04ad-7f18-4333-8a1c-bc41d0aa9bc8 req-cabc29c2-bb70-460a-8bab-b09c36c073ee service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:32.183850 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d3bd04ad-7f18-4333-8a1c-bc41d0aa9bc8 req-cabc29c2-bb70-460a-8bab-b09c36c073ee service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] No waiting events found dispatching network-vif-unplugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:16:32.183850 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-d3bd04ad-7f18-4333-8a1c-bc41d0aa9bc8 req-cabc29c2-bb70-460a-8bab-b09c36c073ee service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received unexpected event network-vif-unplugged-8efef1f6-1c33-4112-a281-960b409908c8 for instance with vm_state active and task_state rescuing. Jan 26 19:16:32.256277 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5359100dcec0f3930af3752a640f2217ee2a6cef.part /opt/stack/data/nova/instances/_base/5359100dcec0f3930af3752a640f2217ee2a6cef.converted" returned: 0 in 0.151s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:32.259528 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5359100dcec0f3930af3752a640f2217ee2a6cef.converted --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:32.355668 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5359100dcec0f3930af3752a640f2217ee2a6cef.converted --force-share --output=json" returned: 0 in 0.096s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:32.356920 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "5359100dcec0f3930af3752a640f2217ee2a6cef" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.020s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:32.358072 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:16:32.365842 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:16:32.368616 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "5359100dcec0f3930af3752a640f2217ee2a6cef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:32.369343 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "5359100dcec0f3930af3752a640f2217ee2a6cef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:32.370041 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:16:32.378050 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:16:32.378050 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5359100dcec0f3930af3752a640f2217ee2a6cef --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:32.473153 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5359100dcec0f3930af3752a640f2217ee2a6cef --force-share --output=json" returned: 0 in 0.095s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:32.473901 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5359100dcec0f3930af3752a640f2217ee2a6cef,backing_fmt=raw /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk.rescue {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:32.519180 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5359100dcec0f3930af3752a640f2217ee2a6cef,backing_fmt=raw /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk.rescue" returned: 0 in 0.045s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:32.519911 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "5359100dcec0f3930af3752a640f2217ee2a6cef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.150s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:32.520455 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'migration_context' on Instance uuid 0832d494-61af-4cf9-86e6-3a0293b8f09d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:16:32.743185 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-362811dc-49d2-4e90-85a2-434e86f66f89 req-3382c45b-120a-4604-98a4-972970d9cae3 service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Received event network-vif-unplugged-337720a2-10c1-4f42-ab4f-23bb29c7f627 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:16:32.743508 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-362811dc-49d2-4e90-85a2-434e86f66f89 req-3382c45b-120a-4604-98a4-972970d9cae3 service nova] Acquiring lock "62dba4cc-3bec-479a-9c7a-f656b5b91386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:32.743861 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-362811dc-49d2-4e90-85a2-434e86f66f89 req-3382c45b-120a-4604-98a4-972970d9cae3 service nova] Lock "62dba4cc-3bec-479a-9c7a-f656b5b91386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:32.744101 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-362811dc-49d2-4e90-85a2-434e86f66f89 req-3382c45b-120a-4604-98a4-972970d9cae3 service nova] Lock "62dba4cc-3bec-479a-9c7a-f656b5b91386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:32.744311 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-362811dc-49d2-4e90-85a2-434e86f66f89 req-3382c45b-120a-4604-98a4-972970d9cae3 service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] No waiting events found dispatching network-vif-unplugged-337720a2-10c1-4f42-ab4f-23bb29c7f627 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:16:32.744529 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-362811dc-49d2-4e90-85a2-434e86f66f89 req-3382c45b-120a-4604-98a4-972970d9cae3 service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Received event network-vif-unplugged-337720a2-10c1-4f42-ab4f-23bb29c7f627 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:16:32.744729 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-362811dc-49d2-4e90-85a2-434e86f66f89 req-3382c45b-120a-4604-98a4-972970d9cae3 service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Received event network-vif-deleted-337720a2-10c1-4f42-ab4f-23bb29c7f627 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:16:32.746178 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-362811dc-49d2-4e90-85a2-434e86f66f89 req-3382c45b-120a-4604-98a4-972970d9cae3 service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Neutron deleted interface 337720a2-10c1-4f42-ab4f-23bb29c7f627; detaching it from the instance and deleting it from the info cache Jan 26 19:16:32.746178 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-362811dc-49d2-4e90-85a2-434e86f66f89 req-3382c45b-120a-4604-98a4-972970d9cae3 service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:16:33.025850 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<0832d494-61af-4cf9-86e6-3a0293b8f09d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:16:33.026473 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:16:33.031652 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Start _get_guest_xml network_info=[{"id": "8efef1f6-1c33-4112-a281-960b409908c8", "address": "fa:16:3e:21:ab:44", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "vif_mac": "fa:16:3e:21:ab:44"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efef1f6-1c", "ovs_interfaceid": "8efef1f6-1c33-4112-a281-960b409908c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue={'image_id': '21106f15-7aa4-4230-9ef0-a719af9a001e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:16:33.032366 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'resources' on Instance uuid 0832d494-61af-4cf9-86e6-3a0293b8f09d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:16:33.080565 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:33.109812 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:16:33.251808 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-362811dc-49d2-4e90-85a2-434e86f66f89 req-3382c45b-120a-4604-98a4-972970d9cae3 service nova] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Detach interface failed, port_id=337720a2-10c1-4f42-ab4f-23bb29c7f627, reason: Instance 62dba4cc-3bec-479a-9c7a-f656b5b91386 could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:16:33.537592 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<0832d494-61af-4cf9-86e6-3a0293b8f09d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:16:33.543928 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:16:33.546837 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-239032308', uuid='0832d494-61af-4cf9-86e6-3a0293b8f09d'), owner=OwnerMeta(userid='2724dd8bb624423083210013b9f090aa', username='tempest-ServerStableDeviceRescueTest-1891281471-project-member', projectid='819c3d68b8b1459bbf07574e4b01f715', projectname='tempest-ServerStableDeviceRescueTest-1891281471'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8efef1f6-1c33-4112-a281-960b409908c8", "address": "fa:16:3e:21:ab:44", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "vif_mac": "fa:16:3e:21:ab:44"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efef1f6-1c", "ovs_interfaceid": "8efef1f6-1c33-4112-a281-960b409908c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769472993.545943) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:16:33.550018 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:16:33.550549 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:16:33.554650 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:16:33.554650 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:16:33.554650 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:16:33.555118 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:16:33.555381 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:16:33.555585 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:16:33.555819 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:16:33.556024 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:16:33.556278 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:16:33.556519 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:16:33.556715 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:16:33.556965 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:16:33.557175 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:16:33.557368 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:16:33.557592 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0832d494-61af-4cf9-86e6-3a0293b8f09d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:16:33.614206 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Took 1.65 seconds to deallocate network for instance. Jan 26 19:16:33.637923 np0005596550.novalocal nova-compute[189076]: WARNING nova.volume.cinder [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Attachment 59fdad93-8cf6-473e-bf5c-7f2eb74495b7 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 59fdad93-8cf6-473e-bf5c-7f2eb74495b7. (HTTP 404) (Request-ID: req-13f47ded-6dea-4d21-991f-4dcdb11cd056) Jan 26 19:16:33.638265 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Took 0.02 seconds to detach 1 volumes for instance. Jan 26 19:16:34.062815 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<0832d494-61af-4cf9-86e6-3a0293b8f09d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:16:34.064576 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk.config --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:34.153158 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:34.153506 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:34.182410 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk.config --force-share --output=json" returned: 0 in 0.117s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:34.182825 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "/opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:34.183255 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:34.183943 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:34.185352 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:16:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-239032308',display_name='tempest-ServerStableDeviceRescueTest-server-239032308',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstabledevicerescuetest-server-239032308',id=95,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:16:16Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='819c3d68b8b1459bbf07574e4b01f715',ramdisk_id='',reservation_id='r-lrtvn96e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1891281471',owner_user_name='tempest-ServerStableDeviceRescueTest-1891281471-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:16:24Z,user_data=None,user_id='2724dd8bb624423083210013b9f090aa',uuid=0832d494-61af-4cf9-86e6-3a0293b8f09d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8efef1f6-1c33-4112-a281-960b409908c8", "address": "fa:16:3e:21:ab:44", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "vif_mac": "fa:16:3e:21:ab:44"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efef1f6-1c", "ovs_interfaceid": "8efef1f6-1c33-4112-a281-960b409908c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:16:34.185552 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converting VIF {"id": "8efef1f6-1c33-4112-a281-960b409908c8", "address": "fa:16:3e:21:ab:44", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "vif_mac": "fa:16:3e:21:ab:44"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efef1f6-1c", "ovs_interfaceid": "8efef1f6-1c33-4112-a281-960b409908c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:16:34.186240 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:ab:44,bridge_name='br-int',has_traffic_filtering=True,id=8efef1f6-1c33-4112-a281-960b409908c8,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8efef1f6-1c') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:16:34.187195 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'pci_devices' on Instance uuid 0832d494-61af-4cf9-86e6-3a0293b8f09d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:16:34.336308 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:16:34.691846 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<0832d494-61af-4cf9-86e6-3a0293b8f09d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] End _get_guest_xml xml= Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: 0832d494-61af-4cf9-86e6-3a0293b8f09d Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: instance-0000005f Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-server-239032308 Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:16:33 Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: ide Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: pc Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-1891281471-project-member Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-1891281471 Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: 0832d494-61af-4cf9-86e6-3a0293b8f09d Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: 0832d494-61af-4cf9-86e6-3a0293b8f09d Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:34.693627 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:16:34.700861 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Instance destroyed successfully. Jan 26 19:16:34.840803 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:16:35.350126 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.196s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:35.405631 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Deleted allocations for instance 62dba4cc-3bec-479a-9c7a-f656b5b91386 Jan 26 19:16:36.226476 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:16:36.226913 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name vdb, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:16:36.227163 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:16:36.227456 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No VIF found with MAC fa:16:3e:21:ab:44, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:16:36.228655 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Using config drive Jan 26 19:16:36.372946 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:36.422623 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8d51a2ac-4e20-4ff1-8951-f66e3ed74fd5 tempest-VolumesBackupsTest-97611117 tempest-VolumesBackupsTest-97611117-project-member] Lock "62dba4cc-3bec-479a-9c7a-f656b5b91386" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.441s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:36.735787 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'ec2_ids' on Instance uuid 0832d494-61af-4cf9-86e6-3a0293b8f09d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:16:37.240570 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<0832d494-61af-4cf9-86e6-3a0293b8f09d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:16:37.241156 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'keypairs' on Instance uuid 0832d494-61af-4cf9-86e6-3a0293b8f09d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:16:37.747863 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<0832d494-61af-4cf9-86e6-3a0293b8f09d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:16:37.754312 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:16:37.874012 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Creating config drive at /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk.config.rescue Jan 26 19:16:37.882179 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpe25_fvx2 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:38.014843 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpe25_fvx2" returned: 0 in 0.131s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:38.116334 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:38.152542 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:38.167793 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:38.317837 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:38.324298 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:38.377024 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6380da53-1e4a-40ad-86ea-c1f8ef0eb2ac req-97c42b0a-3f8c-4719-9b00-2eb9074a9ba6 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received event network-vif-plugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:16:38.377024 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6380da53-1e4a-40ad-86ea-c1f8ef0eb2ac req-97c42b0a-3f8c-4719-9b00-2eb9074a9ba6 service nova] Acquiring lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:38.377024 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6380da53-1e4a-40ad-86ea-c1f8ef0eb2ac req-97c42b0a-3f8c-4719-9b00-2eb9074a9ba6 service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:38.377024 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6380da53-1e4a-40ad-86ea-c1f8ef0eb2ac req-97c42b0a-3f8c-4719-9b00-2eb9074a9ba6 service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:38.377024 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6380da53-1e4a-40ad-86ea-c1f8ef0eb2ac req-97c42b0a-3f8c-4719-9b00-2eb9074a9ba6 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] No waiting events found dispatching network-vif-plugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:16:38.377024 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-6380da53-1e4a-40ad-86ea-c1f8ef0eb2ac req-97c42b0a-3f8c-4719-9b00-2eb9074a9ba6 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received unexpected event network-vif-plugged-8efef1f6-1c33-4112-a281-960b409908c8 for instance with vm_state active and task_state rescuing. Jan 26 19:16:38.416841 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for 0832d494-61af-4cf9-86e6-3a0293b8f09d due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:16:38.416841 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:16:38.416841 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] VM Resumed (Lifecycle Event) Jan 26 19:16:38.425805 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-bf166a42-6924-465f-a764-0cd61c35ddef tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:16:38.927502 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:16:38.935864 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:16:39.453790 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:16:39.454390 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] VM Started (Lifecycle Event) Jan 26 19:16:39.739581 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-1a89be8e-3253-4e67-a51c-00a4a72ef60b tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Unrescuing Jan 26 19:16:39.740076 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-1a89be8e-3253-4e67-a51c-00a4a72ef60b tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "refresh_cache-0832d494-61af-4cf9-86e6-3a0293b8f09d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:16:39.740301 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-1a89be8e-3253-4e67-a51c-00a4a72ef60b tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquired lock "refresh_cache-0832d494-61af-4cf9-86e6-3a0293b8f09d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:16:39.740675 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-1a89be8e-3253-4e67-a51c-00a4a72ef60b tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:16:39.960072 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:16:39.964563 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:16:40.246817 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-1a89be8e-3253-4e67-a51c-00a4a72ef60b tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:16:40.414702 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-37c877d6-faba-4ecb-8d60-8a7d8d645e1f req-6fa57e2d-8862-4e2b-a138-00fbb72e3a72 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received event network-vif-plugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:16:40.415880 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-37c877d6-faba-4ecb-8d60-8a7d8d645e1f req-6fa57e2d-8862-4e2b-a138-00fbb72e3a72 service nova] Acquiring lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:40.415880 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-37c877d6-faba-4ecb-8d60-8a7d8d645e1f req-6fa57e2d-8862-4e2b-a138-00fbb72e3a72 service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:40.415880 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-37c877d6-faba-4ecb-8d60-8a7d8d645e1f req-6fa57e2d-8862-4e2b-a138-00fbb72e3a72 service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:40.415880 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-37c877d6-faba-4ecb-8d60-8a7d8d645e1f req-6fa57e2d-8862-4e2b-a138-00fbb72e3a72 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] No waiting events found dispatching network-vif-plugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:16:40.415880 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-37c877d6-faba-4ecb-8d60-8a7d8d645e1f req-6fa57e2d-8862-4e2b-a138-00fbb72e3a72 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received unexpected event network-vif-plugged-8efef1f6-1c33-4112-a281-960b409908c8 for instance with vm_state rescued and task_state unrescuing. Jan 26 19:16:40.469212 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] During sync_power_state the instance has a pending task (unrescuing). Skip. Jan 26 19:16:40.606133 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-1a89be8e-3253-4e67-a51c-00a4a72ef60b tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:16:40.883733 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-1a89be8e-3253-4e67-a51c-00a4a72ef60b tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Updating instance_info_cache with network_info: [{"id": "8efef1f6-1c33-4112-a281-960b409908c8", "address": "fa:16:3e:21:ab:44", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efef1f6-1c", "ovs_interfaceid": "8efef1f6-1c33-4112-a281-960b409908c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:16:41.377581 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:41.391102 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-1a89be8e-3253-4e67-a51c-00a4a72ef60b tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Releasing lock "refresh_cache-0832d494-61af-4cf9-86e6-3a0293b8f09d" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:16:41.391102 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-1a89be8e-3253-4e67-a51c-00a4a72ef60b tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'flavor' on Instance uuid 0832d494-61af-4cf9-86e6-3a0293b8f09d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:16:41.935968 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:41.940813 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:41.942271 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:42.093185 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:42.103030 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:42.135622 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:42.150860 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:42.201434 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Instance destroyed successfully. Jan 26 19:16:42.201809 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-1a89be8e-3253-4e67-a51c-00a4a72ef60b tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'numa_topology' on Instance uuid 0832d494-61af-4cf9-86e6-3a0293b8f09d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:16:42.512973 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6c22397d-7994-4a0d-98aa-85976bb6ee4a req-7cd96872-f154-4f0e-8949-4db9fd8f9ea7 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received event network-vif-unplugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:16:42.516383 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6c22397d-7994-4a0d-98aa-85976bb6ee4a req-7cd96872-f154-4f0e-8949-4db9fd8f9ea7 service nova] Acquiring lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:42.517542 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6c22397d-7994-4a0d-98aa-85976bb6ee4a req-7cd96872-f154-4f0e-8949-4db9fd8f9ea7 service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.004s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:42.517618 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6c22397d-7994-4a0d-98aa-85976bb6ee4a req-7cd96872-f154-4f0e-8949-4db9fd8f9ea7 service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:42.518273 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6c22397d-7994-4a0d-98aa-85976bb6ee4a req-7cd96872-f154-4f0e-8949-4db9fd8f9ea7 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] No waiting events found dispatching network-vif-unplugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:16:42.518273 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-6c22397d-7994-4a0d-98aa-85976bb6ee4a req-7cd96872-f154-4f0e-8949-4db9fd8f9ea7 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received unexpected event network-vif-unplugged-8efef1f6-1c33-4112-a281-960b409908c8 for instance with vm_state rescued and task_state unrescuing. Jan 26 19:16:42.638229 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:42.705424 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-1a89be8e-3253-4e67-a51c-00a4a72ef60b tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<0832d494-61af-4cf9-86e6-3a0293b8f09d> lazy-loaded attributes: flavor,numa_topology {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:16:42.796792 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:42.816077 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:42.966620 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:42.967930 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:42.989016 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-1a89be8e-3253-4e67-a51c-00a4a72ef60b tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:16:42.989278 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for 0832d494-61af-4cf9-86e6-3a0293b8f09d due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:16:42.989458 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:16:42.989631 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] VM Resumed (Lifecycle Event) Jan 26 19:16:43.120159 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:43.495963 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:16:43.502620 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:16:43.912150 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:44.010137 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:16:44.010137 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] VM Started (Lifecycle Event) Jan 26 19:16:44.516152 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:16:44.522330 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:16:44.564516 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-fca7b286-b245-4a5d-8fd2-df81f1aa2cd1 req-8b130990-a614-4e25-b6a7-be0946404a08 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received event network-vif-unplugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:16:44.564749 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fca7b286-b245-4a5d-8fd2-df81f1aa2cd1 req-8b130990-a614-4e25-b6a7-be0946404a08 service nova] Acquiring lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:44.565710 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fca7b286-b245-4a5d-8fd2-df81f1aa2cd1 req-8b130990-a614-4e25-b6a7-be0946404a08 service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:44.568592 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fca7b286-b245-4a5d-8fd2-df81f1aa2cd1 req-8b130990-a614-4e25-b6a7-be0946404a08 service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:44.568592 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-fca7b286-b245-4a5d-8fd2-df81f1aa2cd1 req-8b130990-a614-4e25-b6a7-be0946404a08 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] No waiting events found dispatching network-vif-unplugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:16:44.568592 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-fca7b286-b245-4a5d-8fd2-df81f1aa2cd1 req-8b130990-a614-4e25-b6a7-be0946404a08 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received unexpected event network-vif-unplugged-8efef1f6-1c33-4112-a281-960b409908c8 for instance with vm_state active and task_state None. Jan 26 19:16:44.568592 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-fca7b286-b245-4a5d-8fd2-df81f1aa2cd1 req-8b130990-a614-4e25-b6a7-be0946404a08 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received event network-vif-plugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:16:44.568592 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fca7b286-b245-4a5d-8fd2-df81f1aa2cd1 req-8b130990-a614-4e25-b6a7-be0946404a08 service nova] Acquiring lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:44.568592 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fca7b286-b245-4a5d-8fd2-df81f1aa2cd1 req-8b130990-a614-4e25-b6a7-be0946404a08 service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:44.568592 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fca7b286-b245-4a5d-8fd2-df81f1aa2cd1 req-8b130990-a614-4e25-b6a7-be0946404a08 service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:44.568592 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-fca7b286-b245-4a5d-8fd2-df81f1aa2cd1 req-8b130990-a614-4e25-b6a7-be0946404a08 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] No waiting events found dispatching network-vif-plugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:16:44.568592 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-fca7b286-b245-4a5d-8fd2-df81f1aa2cd1 req-8b130990-a614-4e25-b6a7-be0946404a08 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received unexpected event network-vif-plugged-8efef1f6-1c33-4112-a281-960b409908c8 for instance with vm_state active and task_state None. Jan 26 19:16:44.568592 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-fca7b286-b245-4a5d-8fd2-df81f1aa2cd1 req-8b130990-a614-4e25-b6a7-be0946404a08 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received event network-vif-plugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:16:44.568592 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fca7b286-b245-4a5d-8fd2-df81f1aa2cd1 req-8b130990-a614-4e25-b6a7-be0946404a08 service nova] Acquiring lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:44.568592 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fca7b286-b245-4a5d-8fd2-df81f1aa2cd1 req-8b130990-a614-4e25-b6a7-be0946404a08 service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:44.568592 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fca7b286-b245-4a5d-8fd2-df81f1aa2cd1 req-8b130990-a614-4e25-b6a7-be0946404a08 service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:44.568592 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-fca7b286-b245-4a5d-8fd2-df81f1aa2cd1 req-8b130990-a614-4e25-b6a7-be0946404a08 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] No waiting events found dispatching network-vif-plugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:16:44.569119 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-fca7b286-b245-4a5d-8fd2-df81f1aa2cd1 req-8b130990-a614-4e25-b6a7-be0946404a08 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received unexpected event network-vif-plugged-8efef1f6-1c33-4112-a281-960b409908c8 for instance with vm_state active and task_state None. Jan 26 19:16:45.815079 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:16:45.815079 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] VM Stopped (Lifecycle Event) Jan 26 19:16:46.320630 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-676f0ae8-11a7-4cff-b23f-2ec46ecbd9e4 None None] [instance: 62dba4cc-3bec-479a-9c7a-f656b5b91386] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:16:46.345151 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:46.345434 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:46.378282 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:46.849597 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:16:47.458460 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:47.459144 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:47.466485 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:16:47.466746 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Claim successful on node np0005596550.novalocal Jan 26 19:16:48.164340 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:48.685091 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:16:49.195003 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:16:49.706794 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.245s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:49.706794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:16:50.215792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:16:50.216786 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:16:50.216786 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:16:50.216918 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:16:50.335449 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2724dd8bb624423083210013b9f090aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3d68b8b1459bbf07574e4b01f715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:16:50.729994 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:16:50.972650 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Successfully created port: 96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:16:51.231662 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:16:51.379809 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:51.615570 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Successfully updated port: 96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:16:51.652166 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-81b2a6b2-1025-43ff-a903-d4e5a53c4dfc req-b39c3f83-85b6-488a-a4b0-718a2522fc1d service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received event network-changed-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:16:51.652166 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-81b2a6b2-1025-43ff-a903-d4e5a53c4dfc req-b39c3f83-85b6-488a-a4b0-718a2522fc1d service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Refreshing instance network info cache due to event network-changed-96843dd0-63a1-4a46-a52d-4514f5f72c58. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:16:51.652166 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-81b2a6b2-1025-43ff-a903-d4e5a53c4dfc req-b39c3f83-85b6-488a-a4b0-718a2522fc1d service nova] Acquiring lock "refresh_cache-52b2c186-689c-4294-a2b4-d8b58f1a4cdb" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:16:51.652166 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-81b2a6b2-1025-43ff-a903-d4e5a53c4dfc req-b39c3f83-85b6-488a-a4b0-718a2522fc1d service nova] Acquired lock "refresh_cache-52b2c186-689c-4294-a2b4-d8b58f1a4cdb" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:16:51.652166 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-81b2a6b2-1025-43ff-a903-d4e5a53c4dfc req-b39c3f83-85b6-488a-a4b0-718a2522fc1d service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Refreshing network info cache for port 96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:16:52.119810 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "refresh_cache-52b2c186-689c-4294-a2b4-d8b58f1a4cdb" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:16:52.158891 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-81b2a6b2-1025-43ff-a903-d4e5a53c4dfc req-b39c3f83-85b6-488a-a4b0-718a2522fc1d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:16:52.246370 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:16:52.247698 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:16:52.248334 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Creating image(s) Jan 26 19:16:52.249007 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "/opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:52.249373 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:52.250008 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:52.251925 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:16:52.254646 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:16:52.257256 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:52.279320 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-81b2a6b2-1025-43ff-a903-d4e5a53c4dfc req-b39c3f83-85b6-488a-a4b0-718a2522fc1d service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:16:52.381540 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.124s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:52.381888 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:52.382432 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:52.382958 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:16:52.385657 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:16:52.386035 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:52.444467 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-81b2a6b2-1025-43ff-a903-d4e5a53c4dfc req-b39c3f83-85b6-488a-a4b0-718a2522fc1d service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:16:52.484205 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.098s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:52.484572 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:52.527701 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk 1073741824" returned: 0 in 0.043s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:52.528145 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.146s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:52.528498 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:52.618932 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.090s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:52.619534 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:16:52.620098 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:52.720654 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:52.721562 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Cannot resize image /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:16:52.722752 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:16:52.723709 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Ensure instance console log exists: /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:16:52.723709 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:52.724404 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:52.724715 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:52.947925 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-81b2a6b2-1025-43ff-a903-d4e5a53c4dfc req-b39c3f83-85b6-488a-a4b0-718a2522fc1d service nova] Releasing lock "refresh_cache-52b2c186-689c-4294-a2b4-d8b58f1a4cdb" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:16:52.948753 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquired lock "refresh_cache-52b2c186-689c-4294-a2b4-d8b58f1a4cdb" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:16:52.949116 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:16:53.203524 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:53.535980 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:16:53.681271 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:16:53.827663 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Updating instance_info_cache with network_info: [{"id": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "address": "fa:16:3e:ed:b9:00", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96843dd0-63", "ovs_interfaceid": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:16:54.334827 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Releasing lock "refresh_cache-52b2c186-689c-4294-a2b4-d8b58f1a4cdb" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:16:54.335187 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Instance network_info: |[{"id": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "address": "fa:16:3e:ed:b9:00", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96843dd0-63", "ovs_interfaceid": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:16:54.337777 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Start _get_guest_xml network_info=[{"id": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "address": "fa:16:3e:ed:b9:00", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96843dd0-63", "ovs_interfaceid": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:16:54.341535 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:16:54.343049 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-1735980629', uuid='52b2c186-689c-4294-a2b4-d8b58f1a4cdb'), owner=OwnerMeta(userid='2724dd8bb624423083210013b9f090aa', username='tempest-ServerStableDeviceRescueTest-1891281471-project-member', projectid='819c3d68b8b1459bbf07574e4b01f715', projectname='tempest-ServerStableDeviceRescueTest-1891281471'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "address": "fa:16:3e:ed:b9:00", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96843dd0-63", "ovs_interfaceid": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769473014.342574) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:16:54.344243 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:16:54.344611 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:16:54.345680 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:16:54.346187 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:16:54.347176 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:16:54.347495 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:16:54.347668 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:16:54.347813 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:16:54.347989 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:16:54.348137 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:16:54.348262 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:16:54.348464 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:16:54.348590 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:16:54.348740 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:16:54.348922 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:16:54.349078 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:16:54.353800 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1735980629',display_name='tempest-ServerStableDeviceRescueTest-server-1735980629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstabledevicerescuetest-server-1735980629',id=96,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHt4WbGf+VTDKkKrST6cvkAaeaHKLeinKi8WHzcR3edCWziVBKfCywnzFD79TXH96+KSKaQJIo/1lJNoPCmhSyJyCIQ+2JVjiS7zuVMily6lwqq9n64A6munflQahqUu6A==',key_name='tempest-keypair-134506363',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='819c3d68b8b1459bbf07574e4b01f715',ramdisk_id='',reservation_id='r-0x86dze2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1891281471',owner_user_name='tempest-ServerStableDeviceRescueTest-1891281471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:16:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2724dd8bb624423083210013b9f090aa',uuid=52b2c186-689c-4294-a2b4-d8b58f1a4cdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "address": "fa:16:3e:ed:b9:00", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96843dd0-63", "ovs_interfaceid": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:16:54.353800 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converting VIF {"id": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "address": "fa:16:3e:ed:b9:00", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96843dd0-63", "ovs_interfaceid": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:16:54.353800 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b9:00,bridge_name='br-int',has_traffic_filtering=True,id=96843dd0-63a1-4a46-a52d-4514f5f72c58,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96843dd0-63') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:16:54.354157 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'pci_devices' on Instance uuid 52b2c186-689c-4294-a2b4-d8b58f1a4cdb {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] End _get_guest_xml xml= Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: instance-00000060 Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-server-1735980629 Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:16:54 Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-1891281471-project-member Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-1891281471 Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: Jan 26 19:16:54.860175 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:16:54.869083 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Preparing to wait for external event network-vif-plugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:16:54.869083 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:54.869083 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:54.869083 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:54.869083 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1735980629',display_name='tempest-ServerStableDeviceRescueTest-server-1735980629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstabledevicerescuetest-server-1735980629',id=96,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHt4WbGf+VTDKkKrST6cvkAaeaHKLeinKi8WHzcR3edCWziVBKfCywnzFD79TXH96+KSKaQJIo/1lJNoPCmhSyJyCIQ+2JVjiS7zuVMily6lwqq9n64A6munflQahqUu6A==',key_name='tempest-keypair-134506363',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='819c3d68b8b1459bbf07574e4b01f715',ramdisk_id='',reservation_id='r-0x86dze2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1891281471',owner_user_name='tempest-ServerStableDeviceRescueTest-1891281471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:16:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2724dd8bb624423083210013b9f090aa',uuid=52b2c186-689c-4294-a2b4-d8b58f1a4cdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "address": "fa:16:3e:ed:b9:00", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96843dd0-63", "ovs_interfaceid": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:16:54.869473 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converting VIF {"id": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "address": "fa:16:3e:ed:b9:00", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96843dd0-63", "ovs_interfaceid": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:16:54.869473 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b9:00,bridge_name='br-int',has_traffic_filtering=True,id=96843dd0-63a1-4a46-a52d-4514f5f72c58,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96843dd0-63') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:16:54.869473 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b9:00,bridge_name='br-int',has_traffic_filtering=True,id=96843dd0-63a1-4a46-a52d-4514f5f72c58,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96843dd0-63') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:16:54.869473 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:54.869473 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:16:54.869473 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:16:54.869473 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:54.869473 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c299565-67dd-58bd-a7f0-8bb948a8f35e', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:16:54.869473 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:54.873564 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:54.877667 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:54.878016 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96843dd0-63, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:16:54.878524 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96843dd0-63, col_values=(('qos', UUID('0cb345a4-5130-4265-ba50-016d8e09503d')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:16:54.878850 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96843dd0-63, col_values=(('external_ids', {'iface-id': '96843dd0-63a1-4a46-a52d-4514f5f72c58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:b9:00', 'vm-uuid': '52b2c186-689c-4294-a2b4-d8b58f1a4cdb'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:16:54.880386 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:54.884805 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:16:54.891945 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:54.892857 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b9:00,bridge_name='br-int',has_traffic_filtering=True,id=96843dd0-63a1-4a46-a52d-4514f5f72c58,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96843dd0-63') Jan 26 19:16:56.421498 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:16:56.422008 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:16:56.422008 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No VIF found with MAC fa:16:3e:ed:b9:00, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:16:56.422237 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Using config drive Jan 26 19:16:56.928173 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:16:57.223863 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Creating config drive at /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk.config Jan 26 19:16:57.228258 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpehm88ig9 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:57.356535 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpehm88ig9" returned: 0 in 0.128s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:57.470789 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:57.477195 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:57.487799 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:57.632524 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:57.676455 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:16:57.676455 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] VM Started (Lifecycle Event) Jan 26 19:16:57.705398 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-565b9480-2032-449a-aeaf-b28cb4711de5 req-f60d9c52-96ad-4b39-b40f-f831ce935d35 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received event network-vif-plugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:16:57.705669 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-565b9480-2032-449a-aeaf-b28cb4711de5 req-f60d9c52-96ad-4b39-b40f-f831ce935d35 service nova] Acquiring lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:57.706111 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-565b9480-2032-449a-aeaf-b28cb4711de5 req-f60d9c52-96ad-4b39-b40f-f831ce935d35 service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:57.706111 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-565b9480-2032-449a-aeaf-b28cb4711de5 req-f60d9c52-96ad-4b39-b40f-f831ce935d35 service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:57.718001 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-565b9480-2032-449a-aeaf-b28cb4711de5 req-f60d9c52-96ad-4b39-b40f-f831ce935d35 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Processing event network-vif-plugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:16:57.718001 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:16:57.718001 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:16:57.728575 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Instance spawned successfully. Jan 26 19:16:57.732093 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:16:58.187037 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:16:58.189972 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:16:58.206731 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:16:58.248422 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:16:58.248578 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:16:58.249389 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:16:58.249753 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:16:58.250288 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:16:58.250735 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:16:58.694254 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:16:58.694709 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:16:58.695038 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] VM Paused (Lifecycle Event) Jan 26 19:16:58.765191 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Took 6.52 seconds to spawn the instance on the hypervisor. Jan 26 19:16:58.767333 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:16:59.201814 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:16:59.215666 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:16:59.215666 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] VM Resumed (Lifecycle Event) Jan 26 19:16:59.290723 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Took 11.92 seconds to build instance. Jan 26 19:16:59.718864 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:16:59.723974 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:16:59.768873 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a9da9558-f602-47d2-8104-f9a3ac5d1031 req-157411c7-6833-4c8d-a0a4-5ec4a30de1bf service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received event network-vif-plugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:16:59.768873 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a9da9558-f602-47d2-8104-f9a3ac5d1031 req-157411c7-6833-4c8d-a0a4-5ec4a30de1bf service nova] Acquiring lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:16:59.769013 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a9da9558-f602-47d2-8104-f9a3ac5d1031 req-157411c7-6833-4c8d-a0a4-5ec4a30de1bf service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:16:59.769171 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a9da9558-f602-47d2-8104-f9a3ac5d1031 req-157411c7-6833-4c8d-a0a4-5ec4a30de1bf service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:59.769364 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a9da9558-f602-47d2-8104-f9a3ac5d1031 req-157411c7-6833-4c8d-a0a4-5ec4a30de1bf service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] No waiting events found dispatching network-vif-plugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:16:59.769861 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-a9da9558-f602-47d2-8104-f9a3ac5d1031 req-157411c7-6833-4c8d-a0a4-5ec4a30de1bf service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received unexpected event network-vif-plugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 for instance with vm_state active and task_state None. Jan 26 19:16:59.794092 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-453d596e-905c-40fa-af5f-1e597cacd0e6 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 13.448s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:16:59.880578 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:02.091442 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3ef8001b-ccc1-4211-aa41-608f6c5b1828 req-4dd673f4-ef83-4e62-854f-3771f5713720 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received event network-changed-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:17:02.091811 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3ef8001b-ccc1-4211-aa41-608f6c5b1828 req-4dd673f4-ef83-4e62-854f-3771f5713720 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Refreshing instance network info cache due to event network-changed-96843dd0-63a1-4a46-a52d-4514f5f72c58. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:17:02.091897 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3ef8001b-ccc1-4211-aa41-608f6c5b1828 req-4dd673f4-ef83-4e62-854f-3771f5713720 service nova] Acquiring lock "refresh_cache-52b2c186-689c-4294-a2b4-d8b58f1a4cdb" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:17:02.093485 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3ef8001b-ccc1-4211-aa41-608f6c5b1828 req-4dd673f4-ef83-4e62-854f-3771f5713720 service nova] Acquired lock "refresh_cache-52b2c186-689c-4294-a2b4-d8b58f1a4cdb" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:17:02.093485 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-3ef8001b-ccc1-4211-aa41-608f6c5b1828 req-4dd673f4-ef83-4e62-854f-3771f5713720 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Refreshing network info cache for port 96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:17:02.596177 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-3ef8001b-ccc1-4211-aa41-608f6c5b1828 req-4dd673f4-ef83-4e62-854f-3771f5713720 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:17:02.882060 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-3ef8001b-ccc1-4211-aa41-608f6c5b1828 req-4dd673f4-ef83-4e62-854f-3771f5713720 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:17:02.964419 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-3ef8001b-ccc1-4211-aa41-608f6c5b1828 req-4dd673f4-ef83-4e62-854f-3771f5713720 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Updated VIF entry in instance network info cache for port 96843dd0-63a1-4a46-a52d-4514f5f72c58. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:17:02.964815 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-3ef8001b-ccc1-4211-aa41-608f6c5b1828 req-4dd673f4-ef83-4e62-854f-3771f5713720 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Updating instance_info_cache with network_info: [{"id": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "address": "fa:16:3e:ed:b9:00", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96843dd0-63", "ovs_interfaceid": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:17:03.208173 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:03.468033 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3ef8001b-ccc1-4211-aa41-608f6c5b1828 req-4dd673f4-ef83-4e62-854f-3771f5713720 service nova] Releasing lock "refresh_cache-52b2c186-689c-4294-a2b4-d8b58f1a4cdb" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:17:03.526407 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:04.882786 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:05.434715 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:08.253359 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:08.839942 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Acquiring lock "ed63e88d-2392-46c6-b3d4-bd932dced23b" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:08.840396 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "ed63e88d-2392-46c6-b3d4-bd932dced23b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:09.345276 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:17:09.891883 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:09.921729 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:09.922126 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:09.927143 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:17:09.927359 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Claim successful on node np0005596550.novalocal Jan 26 19:17:11.147298 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:17:11.651523 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:17:12.158177 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.235s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:12.159088 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:17:12.670429 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:17:12.670677 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:17:12.671149 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:17:12.671459 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:17:12.774931 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1729057bcbee4cb9a971a59252ec610b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97c7d9505d54b65a6aa5f015da34441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:17:13.175694 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:17:13.258148 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:13.363612 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Successfully created port: 7325dc64-c927-4c17-9897-8a7faf9f3c5e {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:17:13.682798 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:17:13.885923 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Successfully updated port: 7325dc64-c927-4c17-9897-8a7faf9f3c5e {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:17:13.920384 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-661a0466-9a38-4390-a6e9-af90c02b5dae req-181fbf7f-7333-49ae-a1e0-f0c8fcd97ed9 service nova] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Received event network-changed-7325dc64-c927-4c17-9897-8a7faf9f3c5e {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:17:13.920571 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-661a0466-9a38-4390-a6e9-af90c02b5dae req-181fbf7f-7333-49ae-a1e0-f0c8fcd97ed9 service nova] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Refreshing instance network info cache due to event network-changed-7325dc64-c927-4c17-9897-8a7faf9f3c5e. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:17:13.927371 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-661a0466-9a38-4390-a6e9-af90c02b5dae req-181fbf7f-7333-49ae-a1e0-f0c8fcd97ed9 service nova] Acquiring lock "refresh_cache-ed63e88d-2392-46c6-b3d4-bd932dced23b" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:17:13.927371 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-661a0466-9a38-4390-a6e9-af90c02b5dae req-181fbf7f-7333-49ae-a1e0-f0c8fcd97ed9 service nova] Acquired lock "refresh_cache-ed63e88d-2392-46c6-b3d4-bd932dced23b" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:17:13.927371 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-661a0466-9a38-4390-a6e9-af90c02b5dae req-181fbf7f-7333-49ae-a1e0-f0c8fcd97ed9 service nova] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Refreshing network info cache for port 7325dc64-c927-4c17-9897-8a7faf9f3c5e {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:17:14.389479 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Acquiring lock "refresh_cache-ed63e88d-2392-46c6-b3d4-bd932dced23b" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:17:14.436093 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-661a0466-9a38-4390-a6e9-af90c02b5dae req-181fbf7f-7333-49ae-a1e0-f0c8fcd97ed9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:17:14.533229 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-661a0466-9a38-4390-a6e9-af90c02b5dae req-181fbf7f-7333-49ae-a1e0-f0c8fcd97ed9 service nova] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:17:14.697457 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:17:14.697457 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:17:14.697457 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Creating image(s) Jan 26 19:17:14.697457 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed63e88d-2392-46c6-b3d4-bd932dced23b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:14.697457 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "/opt/stack/data/nova/instances/ed63e88d-2392-46c6-b3d4-bd932dced23b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:14.697754 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "/opt/stack/data/nova/instances/ed63e88d-2392-46c6-b3d4-bd932dced23b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:14.698307 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:17:14.701112 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:17:14.702174 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:14.729665 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-661a0466-9a38-4390-a6e9-af90c02b5dae req-181fbf7f-7333-49ae-a1e0-f0c8fcd97ed9 service nova] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:17:14.773561 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.071s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:14.773795 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:14.774158 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:14.774488 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:17:14.777483 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:17:14.777849 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:14.843328 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.064s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:14.844144 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/ed63e88d-2392-46c6-b3d4-bd932dced23b/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:14.880805 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/ed63e88d-2392-46c6-b3d4-bd932dced23b/disk 1073741824" returned: 0 in 0.036s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:14.881384 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.107s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:14.881923 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:14.895949 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:14.949442 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.067s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:14.949974 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed63e88d-2392-46c6-b3d4-bd932dced23b/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:17:14.950388 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed63e88d-2392-46c6-b3d4-bd932dced23b/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:15.056547 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed63e88d-2392-46c6-b3d4-bd932dced23b/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:15.056883 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Cannot resize image /opt/stack/data/nova/instances/ed63e88d-2392-46c6-b3d4-bd932dced23b/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:17:15.057172 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:17:15.057357 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Ensure instance console log exists: /opt/stack/data/nova/instances/ed63e88d-2392-46c6-b3d4-bd932dced23b/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:17:15.057712 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:15.057986 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:15.058145 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:15.233110 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-661a0466-9a38-4390-a6e9-af90c02b5dae req-181fbf7f-7333-49ae-a1e0-f0c8fcd97ed9 service nova] Releasing lock "refresh_cache-ed63e88d-2392-46c6-b3d4-bd932dced23b" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:17:15.233561 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Acquired lock "refresh_cache-ed63e88d-2392-46c6-b3d4-bd932dced23b" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:17:15.233735 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:17:15.875816 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:17:16.056830 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:17:16.165315 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Updating instance_info_cache with network_info: [{"id": "7325dc64-c927-4c17-9897-8a7faf9f3c5e", "address": "fa:16:3e:ab:ae:55", "network": {"id": "ebbbdeb3-db32-4e26-b65f-fce9b79ab156", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1663898177-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97c7d9505d54b65a6aa5f015da34441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7325dc64-c9", "ovs_interfaceid": "7325dc64-c927-4c17-9897-8a7faf9f3c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:17:16.668953 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Releasing lock "refresh_cache-ed63e88d-2392-46c6-b3d4-bd932dced23b" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:17:16.669479 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Instance network_info: |[{"id": "7325dc64-c927-4c17-9897-8a7faf9f3c5e", "address": "fa:16:3e:ab:ae:55", "network": {"id": "ebbbdeb3-db32-4e26-b65f-fce9b79ab156", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1663898177-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97c7d9505d54b65a6aa5f015da34441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7325dc64-c9", "ovs_interfaceid": "7325dc64-c927-4c17-9897-8a7faf9f3c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:17:16.672663 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Start _get_guest_xml network_info=[{"id": "7325dc64-c927-4c17-9897-8a7faf9f3c5e", "address": "fa:16:3e:ab:ae:55", "network": {"id": "ebbbdeb3-db32-4e26-b65f-fce9b79ab156", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1663898177-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97c7d9505d54b65a6aa5f015da34441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7325dc64-c9", "ovs_interfaceid": "7325dc64-c927-4c17-9897-8a7faf9f3c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:17:16.679548 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:17:16.682017 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-614702530', uuid='ed63e88d-2392-46c6-b3d4-bd932dced23b'), owner=OwnerMeta(userid='1729057bcbee4cb9a971a59252ec610b', username='tempest-VolumesActionsTest-1801349853-project-member', projectid='c97c7d9505d54b65a6aa5f015da34441', projectname='tempest-VolumesActionsTest-1801349853'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7325dc64-c927-4c17-9897-8a7faf9f3c5e", "address": "fa:16:3e:ab:ae:55", "network": {"id": "ebbbdeb3-db32-4e26-b65f-fce9b79ab156", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1663898177-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97c7d9505d54b65a6aa5f015da34441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7325dc64-c9", "ovs_interfaceid": "7325dc64-c927-4c17-9897-8a7faf9f3c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769473036.681281) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:17:16.684343 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:17:16.685188 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:17:16.687192 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:17:16.687853 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:17:16.689959 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:17:16.690739 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:17:16.691175 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:17:16.691545 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:17:16.691960 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:17:16.692246 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:17:16.692548 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:17:16.693118 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:17:16.693426 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:17:16.693808 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:17:16.694173 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:17:16.694540 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:17:16.700975 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-614702530',display_name='tempest-VolumesActionsTest-instance-614702530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-volumesactionstest-instance-614702530',id=97,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97c7d9505d54b65a6aa5f015da34441',ramdisk_id='',reservation_id='r-ginqpf9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1801349853',owner_user_name='tempest-VolumesActionsTest-1801349853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:17:13Z,user_data=None,user_id='1729057bcbee4cb9a971a59252ec610b',uuid=ed63e88d-2392-46c6-b3d4-bd932dced23b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7325dc64-c927-4c17-9897-8a7faf9f3c5e", "address": "fa:16:3e:ab:ae:55", "network": {"id": "ebbbdeb3-db32-4e26-b65f-fce9b79ab156", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1663898177-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97c7d9505d54b65a6aa5f015da34441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7325dc64-c9", "ovs_interfaceid": "7325dc64-c927-4c17-9897-8a7faf9f3c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:17:16.701420 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Converting VIF {"id": "7325dc64-c927-4c17-9897-8a7faf9f3c5e", "address": "fa:16:3e:ab:ae:55", "network": {"id": "ebbbdeb3-db32-4e26-b65f-fce9b79ab156", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1663898177-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97c7d9505d54b65a6aa5f015da34441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7325dc64-c9", "ovs_interfaceid": "7325dc64-c927-4c17-9897-8a7faf9f3c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:17:16.702706 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ae:55,bridge_name='br-int',has_traffic_filtering=True,id=7325dc64-c927-4c17-9897-8a7faf9f3c5e,network=Network(ebbbdeb3-db32-4e26-b65f-fce9b79ab156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7325dc64-c9') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:17:16.704147 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lazy-loading 'pci_devices' on Instance uuid ed63e88d-2392-46c6-b3d4-bd932dced23b {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] End _get_guest_xml xml= Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: ed63e88d-2392-46c6-b3d4-bd932dced23b Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: instance-00000061 Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: tempest-VolumesActionsTest-instance-614702530 Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:17:16 Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: tempest-VolumesActionsTest-1801349853-project-member Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: tempest-VolumesActionsTest-1801349853 Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: ed63e88d-2392-46c6-b3d4-bd932dced23b Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: ed63e88d-2392-46c6-b3d4-bd932dced23b Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:17.210272 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:17:17.212615 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Preparing to wait for external event network-vif-plugged-7325dc64-c927-4c17-9897-8a7faf9f3c5e {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:17:17.212615 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Acquiring lock "ed63e88d-2392-46c6-b3d4-bd932dced23b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:17.212615 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "ed63e88d-2392-46c6-b3d4-bd932dced23b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:17.212615 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "ed63e88d-2392-46c6-b3d4-bd932dced23b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:17.213188 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-614702530',display_name='tempest-VolumesActionsTest-instance-614702530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-volumesactionstest-instance-614702530',id=97,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97c7d9505d54b65a6aa5f015da34441',ramdisk_id='',reservation_id='r-ginqpf9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1801349853',owner_user_name='tempest-VolumesActionsTest-1801349853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:17:13Z,user_data=None,user_id='1729057bcbee4cb9a971a59252ec610b',uuid=ed63e88d-2392-46c6-b3d4-bd932dced23b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7325dc64-c927-4c17-9897-8a7faf9f3c5e", "address": "fa:16:3e:ab:ae:55", "network": {"id": "ebbbdeb3-db32-4e26-b65f-fce9b79ab156", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1663898177-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97c7d9505d54b65a6aa5f015da34441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7325dc64-c9", "ovs_interfaceid": "7325dc64-c927-4c17-9897-8a7faf9f3c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:17:17.213541 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Converting VIF {"id": "7325dc64-c927-4c17-9897-8a7faf9f3c5e", "address": "fa:16:3e:ab:ae:55", "network": {"id": "ebbbdeb3-db32-4e26-b65f-fce9b79ab156", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1663898177-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97c7d9505d54b65a6aa5f015da34441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7325dc64-c9", "ovs_interfaceid": "7325dc64-c927-4c17-9897-8a7faf9f3c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:17:17.214562 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ae:55,bridge_name='br-int',has_traffic_filtering=True,id=7325dc64-c927-4c17-9897-8a7faf9f3c5e,network=Network(ebbbdeb3-db32-4e26-b65f-fce9b79ab156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7325dc64-c9') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:17:17.215098 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ae:55,bridge_name='br-int',has_traffic_filtering=True,id=7325dc64-c927-4c17-9897-8a7faf9f3c5e,network=Network(ebbbdeb3-db32-4e26-b65f-fce9b79ab156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7325dc64-c9') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:17:17.215862 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:17.216453 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:17:17.217004 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:17:17.218322 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:17.218657 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86356a04-5fac-5c69-b4af-8b04a16e3335', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:17:17.263511 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:17.266758 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:17.269558 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:17.269861 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7325dc64-c9, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:17:17.270415 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7325dc64-c9, col_values=(('qos', UUID('18d3635e-7dd0-4ce2-a4ab-cc454c29e39b')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:17:17.270686 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7325dc64-c9, col_values=(('external_ids', {'iface-id': '7325dc64-c927-4c17-9897-8a7faf9f3c5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:ae:55', 'vm-uuid': 'ed63e88d-2392-46c6-b3d4-bd932dced23b'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:17:17.271963 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:17.275290 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:17:17.283892 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:17.285367 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ae:55,bridge_name='br-int',has_traffic_filtering=True,id=7325dc64-c927-4c17-9897-8a7faf9f3c5e,network=Network(ebbbdeb3-db32-4e26-b65f-fce9b79ab156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7325dc64-c9') Jan 26 19:17:18.259687 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:18.814810 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:17:18.814810 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:17:18.814810 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] No VIF found with MAC fa:16:3e:ab:ae:55, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:17:18.814810 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Using config drive Jan 26 19:17:19.324869 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:17:19.426990 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Creating config drive at /opt/stack/data/nova/instances/ed63e88d-2392-46c6-b3d4-bd932dced23b/disk.config Jan 26 19:17:19.429949 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/ed63e88d-2392-46c6-b3d4-bd932dced23b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpeexm02k7 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:19.562969 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/ed63e88d-2392-46c6-b3d4-bd932dced23b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpeexm02k7" returned: 0 in 0.133s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:19.725858 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:19.732077 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:19.737367 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:19.969092 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:17:19.969338 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] VM Started (Lifecycle Event) Jan 26 19:17:20.061909 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-109cbea2-4828-4be4-8972-26610022550d req-41a22bb2-4700-47e7-a535-8155980597dc service nova] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Received event network-vif-plugged-7325dc64-c927-4c17-9897-8a7faf9f3c5e {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:17:20.062142 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-109cbea2-4828-4be4-8972-26610022550d req-41a22bb2-4700-47e7-a535-8155980597dc service nova] Acquiring lock "ed63e88d-2392-46c6-b3d4-bd932dced23b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:20.062348 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-109cbea2-4828-4be4-8972-26610022550d req-41a22bb2-4700-47e7-a535-8155980597dc service nova] Lock "ed63e88d-2392-46c6-b3d4-bd932dced23b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:20.062510 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-109cbea2-4828-4be4-8972-26610022550d req-41a22bb2-4700-47e7-a535-8155980597dc service nova] Lock "ed63e88d-2392-46c6-b3d4-bd932dced23b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:20.062641 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-109cbea2-4828-4be4-8972-26610022550d req-41a22bb2-4700-47e7-a535-8155980597dc service nova] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Processing event network-vif-plugged-7325dc64-c927-4c17-9897-8a7faf9f3c5e {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:17:20.062968 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:20.066014 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:17:20.066234 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:20.070886 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:20.072292 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:17:20.082264 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Instance spawned successfully. Jan 26 19:17:20.082638 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:17:20.477518 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:17:20.482510 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:17:20.592633 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:17:20.592961 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:17:20.593492 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:17:20.593934 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:17:20.594652 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:17:20.595158 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:17:20.989598 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:17:20.990135 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:17:20.990389 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] VM Paused (Lifecycle Event) Jan 26 19:17:21.102276 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Took 6.41 seconds to spawn the instance on the hypervisor. Jan 26 19:17:21.102276 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:17:21.494385 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:17:21.498480 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:17:21.498856 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] VM Resumed (Lifecycle Event) Jan 26 19:17:21.616760 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Took 11.76 seconds to build instance. Jan 26 19:17:21.895822 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:17:21.896041 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:17:22.002582 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:17:22.005811 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:17:22.103093 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-83f2cf2c-b96d-4237-acf5-df443ab31382 req-858cb72c-36e7-4a8e-b77d-361fd980096d service nova] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Received event network-vif-plugged-7325dc64-c927-4c17-9897-8a7faf9f3c5e {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:17:22.103588 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-83f2cf2c-b96d-4237-acf5-df443ab31382 req-858cb72c-36e7-4a8e-b77d-361fd980096d service nova] Acquiring lock "ed63e88d-2392-46c6-b3d4-bd932dced23b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:22.104163 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-83f2cf2c-b96d-4237-acf5-df443ab31382 req-858cb72c-36e7-4a8e-b77d-361fd980096d service nova] Lock "ed63e88d-2392-46c6-b3d4-bd932dced23b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:22.104598 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-83f2cf2c-b96d-4237-acf5-df443ab31382 req-858cb72c-36e7-4a8e-b77d-361fd980096d service nova] Lock "ed63e88d-2392-46c6-b3d4-bd932dced23b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:22.105074 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-83f2cf2c-b96d-4237-acf5-df443ab31382 req-858cb72c-36e7-4a8e-b77d-361fd980096d service nova] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] No waiting events found dispatching network-vif-plugged-7325dc64-c927-4c17-9897-8a7faf9f3c5e {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:17:22.105510 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-83f2cf2c-b96d-4237-acf5-df443ab31382 req-858cb72c-36e7-4a8e-b77d-361fd980096d service nova] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Received unexpected event network-vif-plugged-7325dc64-c927-4c17-9897-8a7faf9f3c5e for instance with vm_state active and task_state None. Jan 26 19:17:22.118799 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-29de6074-58e0-4066-91a7-316d92462474 tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "ed63e88d-2392-46c6-b3d4-bd932dced23b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 13.278s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:22.323513 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:22.402470 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:22.402673 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:22.402798 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:22.403024 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:17:23.262451 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:23.444803 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:23.575438 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:23.575930 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:23.666195 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:23.678691 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:23.791504 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:23.791504 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:23.890471 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:23.896987 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:23.974806 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:23.974806 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:24.078873 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:24.087693 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:24.189444 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:24.190205 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:24.293443 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:24.298586 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed63e88d-2392-46c6-b3d4-bd932dced23b/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:24.364269 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed63e88d-2392-46c6-b3d4-bd932dced23b/disk --force-share --output=json" returned: 0 in 0.065s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:24.364645 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed63e88d-2392-46c6-b3d4-bd932dced23b/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:24.380270 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Acquiring lock "ed63e88d-2392-46c6-b3d4-bd932dced23b" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:24.380472 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "ed63e88d-2392-46c6-b3d4-bd932dced23b" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:24.380666 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Acquiring lock "ed63e88d-2392-46c6-b3d4-bd932dced23b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:24.380888 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "ed63e88d-2392-46c6-b3d4-bd932dced23b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:24.381069 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "ed63e88d-2392-46c6-b3d4-bd932dced23b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:24.384391 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Terminating instance Jan 26 19:17:24.433545 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed63e88d-2392-46c6-b3d4-bd932dced23b/disk --force-share --output=json" returned: 0 in 0.069s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:24.554577 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:17:24.555574 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:24.581614 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.026s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:24.581981 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=6747MB free_disk=372.7069625854492GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:17:24.582124 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:24.582433 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:24.887373 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:17:24.921309 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:24.925006 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:24.929255 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:24.955444 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:24.965597 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:25.052567 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-8d00215d-ba82-40fd-a373-81aeb9c48238 req-747b6dc7-c173-4b76-8187-8c2f24f8162e service nova] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Received event network-vif-unplugged-7325dc64-c927-4c17-9897-8a7faf9f3c5e {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:17:25.052934 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-8d00215d-ba82-40fd-a373-81aeb9c48238 req-747b6dc7-c173-4b76-8187-8c2f24f8162e service nova] Acquiring lock "ed63e88d-2392-46c6-b3d4-bd932dced23b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:25.053183 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-8d00215d-ba82-40fd-a373-81aeb9c48238 req-747b6dc7-c173-4b76-8187-8c2f24f8162e service nova] Lock "ed63e88d-2392-46c6-b3d4-bd932dced23b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:25.053360 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-8d00215d-ba82-40fd-a373-81aeb9c48238 req-747b6dc7-c173-4b76-8187-8c2f24f8162e service nova] Lock "ed63e88d-2392-46c6-b3d4-bd932dced23b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:25.053664 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-8d00215d-ba82-40fd-a373-81aeb9c48238 req-747b6dc7-c173-4b76-8187-8c2f24f8162e service nova] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] No waiting events found dispatching network-vif-unplugged-7325dc64-c927-4c17-9897-8a7faf9f3c5e {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:17:25.054511 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-8d00215d-ba82-40fd-a373-81aeb9c48238 req-747b6dc7-c173-4b76-8187-8c2f24f8162e service nova] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Received event network-vif-unplugged-7325dc64-c927-4c17-9897-8a7faf9f3c5e for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:17:25.123001 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:25.128445 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:25.185920 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Instance destroyed successfully. Jan 26 19:17:25.186427 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lazy-loading 'resources' on Instance uuid ed63e88d-2392-46c6-b3d4-bd932dced23b {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:17:25.646885 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 4b54d0fc-613e-4ce1-8ba9-54651f4079bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:17:25.647485 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 26e2c1ab-94b1-4731-afc4-9c987e187c8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:17:25.647678 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 0832d494-61af-4cf9-86e6-3a0293b8f09d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:17:25.648220 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 52b2c186-689c-4294-a2b4-d8b58f1a4cdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:17:25.648547 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance ed63e88d-2392-46c6-b3d4-bd932dced23b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:17:25.649041 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 5 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:17:25.649388 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=1472MB phys_disk=399GB used_disk=5GB total_vcpus=8 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:17:24 up 45 min, 13 users, load average: 6.23, 5.29, 4.49\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '4', 'num_os_type_None': '5', 'num_proj_819c3d68b8b1459bbf07574e4b01f715': '4', 'io_workload': '0', 'num_task_deleting': '1', 'num_proj_c97c7d9505d54b65a6aa5f015da34441': '1'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:17:25.692188 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-614702530',display_name='tempest-VolumesActionsTest-instance-614702530',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-volumesactionstest-instance-614702530',id=97,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:17:21Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='c97c7d9505d54b65a6aa5f015da34441',ramdisk_id='',reservation_id='r-ginqpf9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1801349853',owner_user_name='tempest-VolumesActionsTest-1801349853-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:17:21Z,user_data=None,user_id='1729057bcbee4cb9a971a59252ec610b',uuid=ed63e88d-2392-46c6-b3d4-bd932dced23b,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7325dc64-c927-4c17-9897-8a7faf9f3c5e", "address": "fa:16:3e:ab:ae:55", "network": {"id": "ebbbdeb3-db32-4e26-b65f-fce9b79ab156", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1663898177-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97c7d9505d54b65a6aa5f015da34441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7325dc64-c9", "ovs_interfaceid": "7325dc64-c927-4c17-9897-8a7faf9f3c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:17:25.692391 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Converting VIF {"id": "7325dc64-c927-4c17-9897-8a7faf9f3c5e", "address": "fa:16:3e:ab:ae:55", "network": {"id": "ebbbdeb3-db32-4e26-b65f-fce9b79ab156", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1663898177-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97c7d9505d54b65a6aa5f015da34441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7325dc64-c9", "ovs_interfaceid": "7325dc64-c927-4c17-9897-8a7faf9f3c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:17:25.693441 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ae:55,bridge_name='br-int',has_traffic_filtering=True,id=7325dc64-c927-4c17-9897-8a7faf9f3c5e,network=Network(ebbbdeb3-db32-4e26-b65f-fce9b79ab156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7325dc64-c9') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:17:25.694085 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ae:55,bridge_name='br-int',has_traffic_filtering=True,id=7325dc64-c927-4c17-9897-8a7faf9f3c5e,network=Network(ebbbdeb3-db32-4e26-b65f-fce9b79ab156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7325dc64-c9') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:17:25.722074 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:25.722641 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7325dc64-c9, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:17:25.776643 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:25.780059 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:17:25.809673 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:25.810540 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18d3635e-7dd0-4ce2-a4ab-cc454c29e39b) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:17:25.815334 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:25.819743 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:17:25.822404 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ae:55,bridge_name='br-int',has_traffic_filtering=True,id=7325dc64-c927-4c17-9897-8a7faf9f3c5e,network=Network(ebbbdeb3-db32-4e26-b65f-fce9b79ab156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7325dc64-c9') Jan 26 19:17:25.822878 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Deleting instance files /opt/stack/data/nova/instances/ed63e88d-2392-46c6-b3d4-bd932dced23b_del Jan 26 19:17:25.823650 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Deletion of /opt/stack/data/nova/instances/ed63e88d-2392-46c6-b3d4-bd932dced23b_del complete Jan 26 19:17:25.927705 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:17:26.332976 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Took 1.45 seconds to destroy the instance on the hypervisor. Jan 26 19:17:26.333165 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:17:26.333354 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:17:26.333462 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:17:26.334056 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:17:26.422476 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:17:26.433785 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:17:26.939904 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:17:26.940625 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.358s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:26.995059 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d4cf688d-ad11-4919-b4ff-3db268726872 req-c8a15438-0100-4089-9012-5ceea49cca2c service nova] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Received event network-vif-deleted-7325dc64-c927-4c17-9897-8a7faf9f3c5e {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:17:26.995166 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-d4cf688d-ad11-4919-b4ff-3db268726872 req-c8a15438-0100-4089-9012-5ceea49cca2c service nova] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Neutron deleted interface 7325dc64-c927-4c17-9897-8a7faf9f3c5e; detaching it from the instance and deleting it from the info cache Jan 26 19:17:26.995299 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-d4cf688d-ad11-4919-b4ff-3db268726872 req-c8a15438-0100-4089-9012-5ceea49cca2c service nova] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:17:27.082220 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-babdc18b-996d-4440-9bf3-ce0d5f977c32 req-6e3526fd-4499-4592-a3ad-226458247765 service nova] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Received event network-vif-unplugged-7325dc64-c927-4c17-9897-8a7faf9f3c5e {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:17:27.082429 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-babdc18b-996d-4440-9bf3-ce0d5f977c32 req-6e3526fd-4499-4592-a3ad-226458247765 service nova] Acquiring lock "ed63e88d-2392-46c6-b3d4-bd932dced23b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:27.082654 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-babdc18b-996d-4440-9bf3-ce0d5f977c32 req-6e3526fd-4499-4592-a3ad-226458247765 service nova] Lock "ed63e88d-2392-46c6-b3d4-bd932dced23b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:27.082990 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-babdc18b-996d-4440-9bf3-ce0d5f977c32 req-6e3526fd-4499-4592-a3ad-226458247765 service nova] Lock "ed63e88d-2392-46c6-b3d4-bd932dced23b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:27.083260 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-babdc18b-996d-4440-9bf3-ce0d5f977c32 req-6e3526fd-4499-4592-a3ad-226458247765 service nova] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] No waiting events found dispatching network-vif-unplugged-7325dc64-c927-4c17-9897-8a7faf9f3c5e {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:17:27.083511 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-babdc18b-996d-4440-9bf3-ce0d5f977c32 req-6e3526fd-4499-4592-a3ad-226458247765 service nova] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Received event network-vif-unplugged-7325dc64-c927-4c17-9897-8a7faf9f3c5e for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:17:27.286276 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:17:27.500757 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d4cf688d-ad11-4919-b4ff-3db268726872 req-c8a15438-0100-4089-9012-5ceea49cca2c service nova] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Detach interface failed, port_id=7325dc64-c927-4c17-9897-8a7faf9f3c5e, reason: Instance ed63e88d-2392-46c6-b3d4-bd932dced23b could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:17:27.790844 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Took 1.46 seconds to deallocate network for instance. Jan 26 19:17:27.940974 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:17:27.941444 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:17:28.267703 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:28.302217 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:28.302561 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:28.625514 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:17:29.130195 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:17:29.638086 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.335s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:29.695801 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Deleted allocations for instance ed63e88d-2392-46c6-b3d4-bd932dced23b Jan 26 19:17:29.895843 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:17:29.895947 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:17:30.713530 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-62b232dd-c804-40b5-9b88-30cbcb04750c tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "ed63e88d-2392-46c6-b3d4-bd932dced23b" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.333s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:30.813690 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:31.892466 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:17:31.895217 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:17:31.895483 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:17:32.254464 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Acquiring lock "7ab671bd-c50f-4726-b486-f24e9de9be75" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:32.254723 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "7ab671bd-c50f-4726-b486-f24e9de9be75" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:32.757628 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:17:33.271069 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:33.304730 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:33.305079 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:33.309036 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:17:33.309261 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Claim successful on node np0005596550.novalocal Jan 26 19:17:34.617665 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:17:35.121063 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:17:35.629614 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.324s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:35.630281 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:17:35.816527 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:36.137512 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:17:36.137876 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:17:36.138285 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:17:36.138595 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:17:36.242505 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1729057bcbee4cb9a971a59252ec610b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97c7d9505d54b65a6aa5f015da34441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:17:36.656740 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:17:36.745554 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Successfully created port: 7e35ccf3-32d5-4a94-8fd5-d4b54877e04b {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:17:37.163206 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:17:37.185820 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Successfully updated port: 7e35ccf3-32d5-4a94-8fd5-d4b54877e04b {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:17:37.216296 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-fe42d432-0dd5-44e7-8414-429903228b75 req-3766cefd-7cc2-465a-998e-0159872684b6 service nova] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Received event network-changed-7e35ccf3-32d5-4a94-8fd5-d4b54877e04b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:17:37.216566 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-fe42d432-0dd5-44e7-8414-429903228b75 req-3766cefd-7cc2-465a-998e-0159872684b6 service nova] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Refreshing instance network info cache due to event network-changed-7e35ccf3-32d5-4a94-8fd5-d4b54877e04b. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:17:37.217618 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fe42d432-0dd5-44e7-8414-429903228b75 req-3766cefd-7cc2-465a-998e-0159872684b6 service nova] Acquiring lock "refresh_cache-7ab671bd-c50f-4726-b486-f24e9de9be75" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:17:37.217618 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fe42d432-0dd5-44e7-8414-429903228b75 req-3766cefd-7cc2-465a-998e-0159872684b6 service nova] Acquired lock "refresh_cache-7ab671bd-c50f-4726-b486-f24e9de9be75" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:17:37.217794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-fe42d432-0dd5-44e7-8414-429903228b75 req-3766cefd-7cc2-465a-998e-0159872684b6 service nova] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Refreshing network info cache for port 7e35ccf3-32d5-4a94-8fd5-d4b54877e04b {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:17:37.689825 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Acquiring lock "refresh_cache-7ab671bd-c50f-4726-b486-f24e9de9be75" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:17:37.722072 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-fe42d432-0dd5-44e7-8414-429903228b75 req-3766cefd-7cc2-465a-998e-0159872684b6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:17:37.757059 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-afb73512-7acd-4aac-bf0b-9b2f1f899940 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:17:37.784693 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-fe42d432-0dd5-44e7-8414-429903228b75 req-3766cefd-7cc2-465a-998e-0159872684b6 service nova] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:17:37.895200 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:17:37.950173 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-fe42d432-0dd5-44e7-8414-429903228b75 req-3766cefd-7cc2-465a-998e-0159872684b6 service nova] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:17:38.177746 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:17:38.179707 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:17:38.180291 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Creating image(s) Jan 26 19:17:38.181279 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ab671bd-c50f-4726-b486-f24e9de9be75/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:38.181743 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "/opt/stack/data/nova/instances/7ab671bd-c50f-4726-b486-f24e9de9be75/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:38.183193 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "/opt/stack/data/nova/instances/7ab671bd-c50f-4726-b486-f24e9de9be75/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:38.185328 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:17:38.192026 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:17:38.194503 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:38.272073 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-afb73512-7acd-4aac-bf0b-9b2f1f899940 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] instance snapshotting Jan 26 19:17:38.276195 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:38.338877 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.144s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:38.339424 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:38.339929 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:38.340414 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:17:38.344455 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:17:38.344867 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:38.370729 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-afb73512-7acd-4aac-bf0b-9b2f1f899940 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Beginning live snapshot process Jan 26 19:17:38.424592 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.079s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:38.425019 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/7ab671bd-c50f-4726-b486-f24e9de9be75/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:38.453857 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fe42d432-0dd5-44e7-8414-429903228b75 req-3766cefd-7cc2-465a-998e-0159872684b6 service nova] Releasing lock "refresh_cache-7ab671bd-c50f-4726-b486-f24e9de9be75" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:17:38.454645 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Acquired lock "refresh_cache-7ab671bd-c50f-4726-b486-f24e9de9be75" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:17:38.454909 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:17:38.489497 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/7ab671bd-c50f-4726-b486-f24e9de9be75/disk 1073741824" returned: 0 in 0.064s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:38.489856 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.150s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:38.490205 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:38.560146 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.069s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:38.560463 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ab671bd-c50f-4726-b486-f24e9de9be75/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:17:38.560738 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ab671bd-c50f-4726-b486-f24e9de9be75/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:38.626372 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ab671bd-c50f-4726-b486-f24e9de9be75/disk --force-share --output=json" returned: 0 in 0.065s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:38.627018 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Cannot resize image /opt/stack/data/nova/instances/7ab671bd-c50f-4726-b486-f24e9de9be75/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:17:38.627625 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:17:38.628247 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Ensure instance console log exists: /opt/stack/data/nova/instances/7ab671bd-c50f-4726-b486-f24e9de9be75/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:17:38.628931 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:38.629395 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:38.629728 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:39.008544 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:17:39.147218 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:17:39.261992 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Updating instance_info_cache with network_info: [{"id": "7e35ccf3-32d5-4a94-8fd5-d4b54877e04b", "address": "fa:16:3e:52:cb:d7", "network": {"id": "ebbbdeb3-db32-4e26-b65f-fce9b79ab156", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1663898177-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97c7d9505d54b65a6aa5f015da34441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e35ccf3-32", "ovs_interfaceid": "7e35ccf3-32d5-4a94-8fd5-d4b54877e04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:17:39.767065 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Releasing lock "refresh_cache-7ab671bd-c50f-4726-b486-f24e9de9be75" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:17:39.767424 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Instance network_info: |[{"id": "7e35ccf3-32d5-4a94-8fd5-d4b54877e04b", "address": "fa:16:3e:52:cb:d7", "network": {"id": "ebbbdeb3-db32-4e26-b65f-fce9b79ab156", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1663898177-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97c7d9505d54b65a6aa5f015da34441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e35ccf3-32", "ovs_interfaceid": "7e35ccf3-32d5-4a94-8fd5-d4b54877e04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:17:39.770023 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Start _get_guest_xml network_info=[{"id": "7e35ccf3-32d5-4a94-8fd5-d4b54877e04b", "address": "fa:16:3e:52:cb:d7", "network": {"id": "ebbbdeb3-db32-4e26-b65f-fce9b79ab156", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1663898177-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97c7d9505d54b65a6aa5f015da34441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e35ccf3-32", "ovs_interfaceid": "7e35ccf3-32d5-4a94-8fd5-d4b54877e04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:17:39.774131 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:17:39.775487 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-1963256419', uuid='7ab671bd-c50f-4726-b486-f24e9de9be75'), owner=OwnerMeta(userid='1729057bcbee4cb9a971a59252ec610b', username='tempest-VolumesActionsTest-1801349853-project-member', projectid='c97c7d9505d54b65a6aa5f015da34441', projectname='tempest-VolumesActionsTest-1801349853'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7e35ccf3-32d5-4a94-8fd5-d4b54877e04b", "address": "fa:16:3e:52:cb:d7", "network": {"id": "ebbbdeb3-db32-4e26-b65f-fce9b79ab156", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1663898177-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97c7d9505d54b65a6aa5f015da34441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e35ccf3-32", "ovs_interfaceid": "7e35ccf3-32d5-4a94-8fd5-d4b54877e04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769473059.7750678) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:17:39.777043 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:17:39.777755 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:17:39.779448 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:17:39.779964 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:17:39.781080 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:17:39.781542 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:17:39.781804 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:17:39.782064 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:17:39.782284 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:17:39.782453 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:17:39.782649 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:17:39.783008 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:17:39.783207 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:17:39.783403 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:17:39.783619 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:17:39.783860 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:17:39.787666 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1963256419',display_name='tempest-VolumesActionsTest-instance-1963256419',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-volumesactionstest-instance-1963256419',id=98,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97c7d9505d54b65a6aa5f015da34441',ramdisk_id='',reservation_id='r-ffsrqljt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1801349853',owner_user_name='tempest-VolumesActionsTest-1801349853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:17:37Z,user_data=None,user_id='1729057bcbee4cb9a971a59252ec610b',uuid=7ab671bd-c50f-4726-b486-f24e9de9be75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e35ccf3-32d5-4a94-8fd5-d4b54877e04b", "address": "fa:16:3e:52:cb:d7", "network": {"id": "ebbbdeb3-db32-4e26-b65f-fce9b79ab156", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1663898177-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97c7d9505d54b65a6aa5f015da34441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e35ccf3-32", "ovs_interfaceid": "7e35ccf3-32d5-4a94-8fd5-d4b54877e04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:17:39.787944 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Converting VIF {"id": "7e35ccf3-32d5-4a94-8fd5-d4b54877e04b", "address": "fa:16:3e:52:cb:d7", "network": {"id": "ebbbdeb3-db32-4e26-b65f-fce9b79ab156", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1663898177-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97c7d9505d54b65a6aa5f015da34441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e35ccf3-32", "ovs_interfaceid": "7e35ccf3-32d5-4a94-8fd5-d4b54877e04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:17:39.788605 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:cb:d7,bridge_name='br-int',has_traffic_filtering=True,id=7e35ccf3-32d5-4a94-8fd5-d4b54877e04b,network=Network(ebbbdeb3-db32-4e26-b65f-fce9b79ab156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e35ccf3-32') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:17:39.789379 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ab671bd-c50f-4726-b486-f24e9de9be75 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:17:39.896031 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afb73512-7acd-4aac-bf0b-9b2f1f899940 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk --force-share --output=json -f qcow2 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:39.985614 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afb73512-7acd-4aac-bf0b-9b2f1f899940 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk --force-share --output=json -f qcow2" returned: 0 in 0.089s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:39.986268 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afb73512-7acd-4aac-bf0b-9b2f1f899940 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk --force-share --output=json -f qcow2 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:40.143701 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afb73512-7acd-4aac-bf0b-9b2f1f899940 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk --force-share --output=json -f qcow2" returned: 0 in 0.157s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:40.144452 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-afb73512-7acd-4aac-bf0b-9b2f1f899940 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:17:40.148661 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-afb73512-7acd-4aac-bf0b-9b2f1f899940 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:17:40.150206 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afb73512-7acd-4aac-bf0b-9b2f1f899940 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:40.184611 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:17:40.184879 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] VM Stopped (Lifecycle Event) Jan 26 19:17:40.255013 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afb73512-7acd-4aac-bf0b-9b2f1f899940 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.105s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:40.255307 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afb73512-7acd-4aac-bf0b-9b2f1f899940 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjy331id0/0779393d0d174eca9e777f10de1feaa4.delta 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:40.288450 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afb73512-7acd-4aac-bf0b-9b2f1f899940 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjy331id0/0779393d0d174eca9e777f10de1feaa4.delta 1073741824" returned: 0 in 0.033s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:40.288864 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-afb73512-7acd-4aac-bf0b-9b2f1f899940 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Quiescing instance not available: QEMU guest agent is not enabled. Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] End _get_guest_xml xml= Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: 7ab671bd-c50f-4726-b486-f24e9de9be75 Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: instance-00000062 Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: tempest-VolumesActionsTest-instance-1963256419 Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:17:39 Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: tempest-VolumesActionsTest-1801349853-project-member Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: tempest-VolumesActionsTest-1801349853 Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: 7ab671bd-c50f-4726-b486-f24e9de9be75 Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: 7ab671bd-c50f-4726-b486-f24e9de9be75 Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:40.292956 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:17:40.294642 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Preparing to wait for external event network-vif-plugged-7e35ccf3-32d5-4a94-8fd5-d4b54877e04b {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:17:40.294642 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Acquiring lock "7ab671bd-c50f-4726-b486-f24e9de9be75-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:40.294642 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "7ab671bd-c50f-4726-b486-f24e9de9be75-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:40.294642 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "7ab671bd-c50f-4726-b486-f24e9de9be75-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:40.295134 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1963256419',display_name='tempest-VolumesActionsTest-instance-1963256419',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-volumesactionstest-instance-1963256419',id=98,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97c7d9505d54b65a6aa5f015da34441',ramdisk_id='',reservation_id='r-ffsrqljt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1801349853',owner_user_name='tempest-VolumesActionsTest-1801349853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:17:37Z,user_data=None,user_id='1729057bcbee4cb9a971a59252ec610b',uuid=7ab671bd-c50f-4726-b486-f24e9de9be75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e35ccf3-32d5-4a94-8fd5-d4b54877e04b", "address": "fa:16:3e:52:cb:d7", "network": {"id": "ebbbdeb3-db32-4e26-b65f-fce9b79ab156", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1663898177-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97c7d9505d54b65a6aa5f015da34441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e35ccf3-32", "ovs_interfaceid": "7e35ccf3-32d5-4a94-8fd5-d4b54877e04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:17:40.295379 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Converting VIF {"id": "7e35ccf3-32d5-4a94-8fd5-d4b54877e04b", "address": "fa:16:3e:52:cb:d7", "network": {"id": "ebbbdeb3-db32-4e26-b65f-fce9b79ab156", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1663898177-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97c7d9505d54b65a6aa5f015da34441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e35ccf3-32", "ovs_interfaceid": "7e35ccf3-32d5-4a94-8fd5-d4b54877e04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:17:40.296036 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:cb:d7,bridge_name='br-int',has_traffic_filtering=True,id=7e35ccf3-32d5-4a94-8fd5-d4b54877e04b,network=Network(ebbbdeb3-db32-4e26-b65f-fce9b79ab156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e35ccf3-32') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:17:40.296354 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:cb:d7,bridge_name='br-int',has_traffic_filtering=True,id=7e35ccf3-32d5-4a94-8fd5-d4b54877e04b,network=Network(ebbbdeb3-db32-4e26-b65f-fce9b79ab156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e35ccf3-32') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:17:40.296860 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:40.297210 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:17:40.297542 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:17:40.298348 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:40.298559 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3fbfdb38-8ec5-5d78-9355-d833e2be5ec6', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:17:40.299410 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:40.301350 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:17:40.303648 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:40.303910 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e35ccf3-32, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:17:40.304240 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e35ccf3-32, col_values=(('qos', UUID('83db4800-1d1a-4177-9c97-d651ffe98a27')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:17:40.304411 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e35ccf3-32, col_values=(('external_ids', {'iface-id': '7e35ccf3-32d5-4a94-8fd5-d4b54877e04b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:cb:d7', 'vm-uuid': '7ab671bd-c50f-4726-b486-f24e9de9be75'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:17:40.305310 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:40.307624 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:17:40.312040 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:40.313576 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:cb:d7,bridge_name='br-int',has_traffic_filtering=True,id=7e35ccf3-32d5-4a94-8fd5-d4b54877e04b,network=Network(ebbbdeb3-db32-4e26-b65f-fce9b79ab156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e35ccf3-32') Jan 26 19:17:40.338937 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-afb73512-7acd-4aac-bf0b-9b2f1f899940 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] COPY block job progress, current cursor: 0 final cursor: 76611584 {{(pid=189076) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:845}} Jan 26 19:17:40.691080 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-272e916f-2881-4a5b-9030-c7d256092075 None None] [instance: ed63e88d-2392-46c6-b3d4-bd932dced23b] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:17:40.841874 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-afb73512-7acd-4aac-bf0b-9b2f1f899940 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] COPY block job progress, current cursor: 76611584 final cursor: 76611584 {{(pid=189076) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:845}} Jan 26 19:17:40.844193 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-afb73512-7acd-4aac-bf0b-9b2f1f899940 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Skipping quiescing instance: QEMU guest agent is not enabled. Jan 26 19:17:40.883893 np0005596550.novalocal nova-compute[189076]: DEBUG nova.privsep.utils [None req-afb73512-7acd-4aac-bf0b-9b2f1f899940 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=189076) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jan 26 19:17:40.883893 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afb73512-7acd-4aac-bf0b-9b2f1f899940 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjy331id0/0779393d0d174eca9e777f10de1feaa4.delta /opt/stack/data/nova/instances/snapshots/tmpjy331id0/0779393d0d174eca9e777f10de1feaa4 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:41.546934 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-afb73512-7acd-4aac-bf0b-9b2f1f899940 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjy331id0/0779393d0d174eca9e777f10de1feaa4.delta /opt/stack/data/nova/instances/snapshots/tmpjy331id0/0779393d0d174eca9e777f10de1feaa4" returned: 0 in 0.663s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:41.552116 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-afb73512-7acd-4aac-bf0b-9b2f1f899940 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Snapshot extracted, beginning image upload Jan 26 19:17:41.842736 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:17:41.843011 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:17:41.843343 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] No VIF found with MAC fa:16:3e:52:cb:d7, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:17:41.845583 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Using config drive Jan 26 19:17:42.357921 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:17:42.475651 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Creating config drive at /opt/stack/data/nova/instances/7ab671bd-c50f-4726-b486-f24e9de9be75/disk.config Jan 26 19:17:42.479349 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/7ab671bd-c50f-4726-b486-f24e9de9be75/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp5d0ndtoy {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:42.607761 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/7ab671bd-c50f-4726-b486-f24e9de9be75/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp5d0ndtoy" returned: 0 in 0.128s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:42.678487 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:42.698265 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:42.707102 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:42.907485 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:17:42.907658 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] VM Started (Lifecycle Event) Jan 26 19:17:42.982536 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:42.985496 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:42.988307 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:42.992670 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:42.996613 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ebe0a0c2-3309-44b3-8d43-ec1521d105af req-04fac0c3-422f-426c-85a7-e28f36b257a8 service nova] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Received event network-vif-plugged-7e35ccf3-32d5-4a94-8fd5-d4b54877e04b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:17:42.997249 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ebe0a0c2-3309-44b3-8d43-ec1521d105af req-04fac0c3-422f-426c-85a7-e28f36b257a8 service nova] Acquiring lock "7ab671bd-c50f-4726-b486-f24e9de9be75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:42.997528 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ebe0a0c2-3309-44b3-8d43-ec1521d105af req-04fac0c3-422f-426c-85a7-e28f36b257a8 service nova] Lock "7ab671bd-c50f-4726-b486-f24e9de9be75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:42.997749 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ebe0a0c2-3309-44b3-8d43-ec1521d105af req-04fac0c3-422f-426c-85a7-e28f36b257a8 service nova] Lock "7ab671bd-c50f-4726-b486-f24e9de9be75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:42.998028 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ebe0a0c2-3309-44b3-8d43-ec1521d105af req-04fac0c3-422f-426c-85a7-e28f36b257a8 service nova] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Processing event network-vif-plugged-7e35ccf3-32d5-4a94-8fd5-d4b54877e04b {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:17:42.999124 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:17:43.005278 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:17:43.008663 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Instance spawned successfully. Jan 26 19:17:43.009836 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:17:43.271381 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:43.412087 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:17:43.419665 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:17:43.522455 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:17:43.522629 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:17:43.523178 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:17:43.523615 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:17:43.524051 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:17:43.524516 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:17:43.923744 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:17:43.924114 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:17:43.924197 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] VM Paused (Lifecycle Event) Jan 26 19:17:44.034309 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Took 5.86 seconds to spawn the instance on the hypervisor. Jan 26 19:17:44.034534 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:17:44.303173 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-afb73512-7acd-4aac-bf0b-9b2f1f899940 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Snapshot image upload complete Jan 26 19:17:44.303528 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-afb73512-7acd-4aac-bf0b-9b2f1f899940 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Took 6.02 seconds to snapshot the instance on the hypervisor. Jan 26 19:17:44.429686 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:17:44.434928 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:17:44.435174 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] VM Resumed (Lifecycle Event) Jan 26 19:17:44.545381 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Took 11.28 seconds to build instance. Jan 26 19:17:44.939485 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:17:44.944140 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:17:45.046346 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a92f77cf-efe3-4a1b-ae7e-740898e960c7 req-3724a77f-efbf-44f3-89d9-28ae92355521 service nova] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Received event network-vif-plugged-7e35ccf3-32d5-4a94-8fd5-d4b54877e04b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:17:45.046567 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a92f77cf-efe3-4a1b-ae7e-740898e960c7 req-3724a77f-efbf-44f3-89d9-28ae92355521 service nova] Acquiring lock "7ab671bd-c50f-4726-b486-f24e9de9be75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:45.046841 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a92f77cf-efe3-4a1b-ae7e-740898e960c7 req-3724a77f-efbf-44f3-89d9-28ae92355521 service nova] Lock "7ab671bd-c50f-4726-b486-f24e9de9be75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:45.046994 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a92f77cf-efe3-4a1b-ae7e-740898e960c7 req-3724a77f-efbf-44f3-89d9-28ae92355521 service nova] Lock "7ab671bd-c50f-4726-b486-f24e9de9be75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:45.047173 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a92f77cf-efe3-4a1b-ae7e-740898e960c7 req-3724a77f-efbf-44f3-89d9-28ae92355521 service nova] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] No waiting events found dispatching network-vif-plugged-7e35ccf3-32d5-4a94-8fd5-d4b54877e04b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:17:45.047398 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-a92f77cf-efe3-4a1b-ae7e-740898e960c7 req-3724a77f-efbf-44f3-89d9-28ae92355521 service nova] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Received unexpected event network-vif-plugged-7e35ccf3-32d5-4a94-8fd5-d4b54877e04b for instance with vm_state active and task_state None. Jan 26 19:17:45.048194 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3335bcb3-a043-4b67-8232-07a103133cfe tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "7ab671bd-c50f-4726-b486-f24e9de9be75" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 12.793s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:45.306476 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:45.375669 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:45.375893 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:45.881762 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'flavor' on Instance uuid 52b2c186-689c-4294-a2b4-d8b58f1a4cdb {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:17:46.442347 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Acquiring lock "7ab671bd-c50f-4726-b486-f24e9de9be75" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:46.443009 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "7ab671bd-c50f-4726-b486-f24e9de9be75" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:46.443009 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Acquiring lock "7ab671bd-c50f-4726-b486-f24e9de9be75-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:46.443009 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "7ab671bd-c50f-4726-b486-f24e9de9be75-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:46.443235 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "7ab671bd-c50f-4726-b486-f24e9de9be75-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:46.445711 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Terminating instance Jan 26 19:17:46.894982 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.519s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:46.949381 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:17:46.974717 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:46.976425 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:46.980668 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:47.001464 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:47.018012 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:47.173174 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:47.185314 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:47.218272 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Instance destroyed successfully. Jan 26 19:17:47.218737 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lazy-loading 'resources' on Instance uuid 7ab671bd-c50f-4726-b486-f24e9de9be75 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:17:47.339528 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ea74aef3-7cbc-4d49-9cbd-201c36a8cc30 req-9ec82389-3390-4d90-8f06-03535f950d76 service nova] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Received event network-vif-unplugged-7e35ccf3-32d5-4a94-8fd5-d4b54877e04b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:17:47.339689 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ea74aef3-7cbc-4d49-9cbd-201c36a8cc30 req-9ec82389-3390-4d90-8f06-03535f950d76 service nova] Acquiring lock "7ab671bd-c50f-4726-b486-f24e9de9be75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:47.340277 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ea74aef3-7cbc-4d49-9cbd-201c36a8cc30 req-9ec82389-3390-4d90-8f06-03535f950d76 service nova] Lock "7ab671bd-c50f-4726-b486-f24e9de9be75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:47.340442 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ea74aef3-7cbc-4d49-9cbd-201c36a8cc30 req-9ec82389-3390-4d90-8f06-03535f950d76 service nova] Lock "7ab671bd-c50f-4726-b486-f24e9de9be75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:47.340578 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ea74aef3-7cbc-4d49-9cbd-201c36a8cc30 req-9ec82389-3390-4d90-8f06-03535f950d76 service nova] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] No waiting events found dispatching network-vif-unplugged-7e35ccf3-32d5-4a94-8fd5-d4b54877e04b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:17:47.340745 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ea74aef3-7cbc-4d49-9cbd-201c36a8cc30 req-9ec82389-3390-4d90-8f06-03535f950d76 service nova] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Received event network-vif-unplugged-7e35ccf3-32d5-4a94-8fd5-d4b54877e04b for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:17:47.723078 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1963256419',display_name='tempest-VolumesActionsTest-instance-1963256419',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-volumesactionstest-instance-1963256419',id=98,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:17:44Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='c97c7d9505d54b65a6aa5f015da34441',ramdisk_id='',reservation_id='r-ffsrqljt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1801349853',owner_user_name='tempest-VolumesActionsTest-1801349853-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:17:44Z,user_data=None,user_id='1729057bcbee4cb9a971a59252ec610b',uuid=7ab671bd-c50f-4726-b486-f24e9de9be75,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e35ccf3-32d5-4a94-8fd5-d4b54877e04b", "address": "fa:16:3e:52:cb:d7", "network": {"id": "ebbbdeb3-db32-4e26-b65f-fce9b79ab156", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1663898177-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97c7d9505d54b65a6aa5f015da34441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e35ccf3-32", "ovs_interfaceid": "7e35ccf3-32d5-4a94-8fd5-d4b54877e04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:17:47.723824 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Converting VIF {"id": "7e35ccf3-32d5-4a94-8fd5-d4b54877e04b", "address": "fa:16:3e:52:cb:d7", "network": {"id": "ebbbdeb3-db32-4e26-b65f-fce9b79ab156", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1663898177-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97c7d9505d54b65a6aa5f015da34441", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e35ccf3-32", "ovs_interfaceid": "7e35ccf3-32d5-4a94-8fd5-d4b54877e04b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:17:47.724392 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:cb:d7,bridge_name='br-int',has_traffic_filtering=True,id=7e35ccf3-32d5-4a94-8fd5-d4b54877e04b,network=Network(ebbbdeb3-db32-4e26-b65f-fce9b79ab156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e35ccf3-32') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:17:47.725168 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:cb:d7,bridge_name='br-int',has_traffic_filtering=True,id=7e35ccf3-32d5-4a94-8fd5-d4b54877e04b,network=Network(ebbbdeb3-db32-4e26-b65f-fce9b79ab156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e35ccf3-32') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:17:47.727201 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:47.727664 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e35ccf3-32, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:17:47.729871 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:47.732373 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:17:47.733950 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:47.735431 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:47.735871 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83db4800-1d1a-4177-9c97-d651ffe98a27) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:17:47.737623 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:47.739068 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:17:47.740191 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:47.743704 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:cb:d7,bridge_name='br-int',has_traffic_filtering=True,id=7e35ccf3-32d5-4a94-8fd5-d4b54877e04b,network=Network(ebbbdeb3-db32-4e26-b65f-fce9b79ab156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e35ccf3-32') Jan 26 19:17:47.744236 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Deleting instance files /opt/stack/data/nova/instances/7ab671bd-c50f-4726-b486-f24e9de9be75_del Jan 26 19:17:47.745619 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Deletion of /opt/stack/data/nova/instances/7ab671bd-c50f-4726-b486-f24e9de9be75_del complete Jan 26 19:17:48.002420 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:48.003808 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:48.003808 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Attaching volume a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 to /dev/vdb Jan 26 19:17:48.065636 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': True, 'host': 'np0005596550.novalocal', 'execute': None}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:17:48.067068 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:48.075352 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:48.075648 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c84f63-f3e7-492d-887c-0b4fcd08b00f]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:17:48.078330 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[3fff07f9-5f1d-4fc4-b8f5-acdae4360413]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:17:48.078330 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:17:48.078330 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:17:48.078330 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:17:48.078330 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:17:48.078330 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:17:48.078330 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:17:48.078330 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:17:48.078330 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:17:48.078330 np0005596550.novalocal nova-compute[189076]: with open_scini_device() as fd: Jan 26 19:17:48.078330 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:17:48.078330 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:17:48.078330 np0005596550.novalocal nova-compute[189076]: return next(self.gen) Jan 26 19:17:48.078330 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^ Jan 26 19:17:48.078330 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:17:48.078330 np0005596550.novalocal nova-compute[189076]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:17:48.078330 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:17:48.078330 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:17:48.078614 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fff07f9-5f1d-4fc4-b8f5-acdae4360413]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:17:48.080621 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.scaleio [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:17:48.081087 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.scaleio [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:17:48.082441 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:48.091860 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:48.091860 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e9425c-821d-45b0-af15-23955cb0e5f0]: (4, ('/dev/vda2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:17:48.092940 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:48.101731 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:48.102092 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b47e1a7-610e-4c89-8265-75633bf4fec8]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:17:48.103324 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[945b9033-dc9b-4e8b-909b-db28fdfff4c7]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:17:48.103875 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): nvme version {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:48.124301 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] 'nvme version' failed. Not Retrying. {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:17:48.124809 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] nvme not present on system {{(pid=189076) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:17:48.127818 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=189076) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:17:48.129477 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.lightos [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:feee:b36b', 'fe80::3066:e1ff:fed0:543d', 'fe80::fc16:3eff:fe21:d52c', 'fe80::fc16:3eff:fe21:ab44', 'fe80::fc16:3eff:feed:b900'] Jan 26 19:17:48.129884 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:17:48.130193 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:17:48.130752 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] <== get_connector_properties: return (64ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': True, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:feee:b36b', 'fe80::3066:e1ff:fed0:543d', 'fe80::fc16:3eff:fe21:d52c', 'fe80::fc16:3eff:fe21:ab44', 'fe80::fc16:3eff:feed:b900']} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:17:48.131251 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.block_device [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Updating existing volume attachment record: a975d885-7597-433f-87a5-4862a00096f3 {{(pid=189076) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jan 26 19:17:48.259424 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Took 1.31 seconds to destroy the instance on the hypervisor. Jan 26 19:17:48.260100 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:17:48.260625 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:17:48.260951 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:17:48.261988 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:17:48.886737 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:17:49.119850 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:49.213836 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5245e7d1-6059-41b3-927d-4955629f0fd2 req-3207a6b0-4357-47e8-857b-7026d67141de service nova] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Received event network-vif-deleted-7e35ccf3-32d5-4a94-8fd5-d4b54877e04b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:17:49.214092 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-5245e7d1-6059-41b3-927d-4955629f0fd2 req-3207a6b0-4357-47e8-857b-7026d67141de service nova] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Neutron deleted interface 7e35ccf3-32d5-4a94-8fd5-d4b54877e04b; detaching it from the instance and deleting it from the info cache Jan 26 19:17:49.214341 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-5245e7d1-6059-41b3-927d-4955629f0fd2 req-3207a6b0-4357-47e8-857b-7026d67141de service nova] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:17:49.410644 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-fd0d30d3-b124-4d49-a13e-6193f41f6a0e req-76126b08-0c46-4123-b505-162b277cb13f service nova] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Received event network-vif-unplugged-7e35ccf3-32d5-4a94-8fd5-d4b54877e04b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:17:49.410897 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fd0d30d3-b124-4d49-a13e-6193f41f6a0e req-76126b08-0c46-4123-b505-162b277cb13f service nova] Acquiring lock "7ab671bd-c50f-4726-b486-f24e9de9be75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:49.411100 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fd0d30d3-b124-4d49-a13e-6193f41f6a0e req-76126b08-0c46-4123-b505-162b277cb13f service nova] Lock "7ab671bd-c50f-4726-b486-f24e9de9be75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:49.411239 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fd0d30d3-b124-4d49-a13e-6193f41f6a0e req-76126b08-0c46-4123-b505-162b277cb13f service nova] Lock "7ab671bd-c50f-4726-b486-f24e9de9be75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:49.411950 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-fd0d30d3-b124-4d49-a13e-6193f41f6a0e req-76126b08-0c46-4123-b505-162b277cb13f service nova] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] No waiting events found dispatching network-vif-unplugged-7e35ccf3-32d5-4a94-8fd5-d4b54877e04b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:17:49.412142 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-fd0d30d3-b124-4d49-a13e-6193f41f6a0e req-76126b08-0c46-4123-b505-162b277cb13f service nova] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Received event network-vif-unplugged-7e35ccf3-32d5-4a94-8fd5-d4b54877e04b for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:17:49.661099 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:17:49.724782 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5245e7d1-6059-41b3-927d-4955629f0fd2 req-3207a6b0-4357-47e8-857b-7026d67141de service nova] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Detach interface failed, port_id=7e35ccf3-32d5-4a94-8fd5-d4b54877e04b, reason: Instance 7ab671bd-c50f-4726-b486-f24e9de9be75 could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:17:50.166187 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Took 1.90 seconds to deallocate network for instance. Jan 26 19:17:50.678299 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:17:50.678486 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:17:50.872746 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:17:51.377339 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:17:51.885735 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.207s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:51.944370 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Deleted allocations for instance 7ab671bd-c50f-4726-b486-f24e9de9be75 Jan 26 19:17:52.216357 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Calling os-brick to attach iSCSI Volume {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jan 26 19:17:52.217725 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1', 'target_lun': 0, 'volume_id': 'a6220f09-dc37-4c0a-aa27-bc60bac7ffb1', 'auth_method': 'CHAP', 'auth_username': 'o4gsMKTu24GWUBBBt7AP', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:17:52.218135 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:17:52.219004 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:17:52.219344 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1', 'target_lun': 0, 'volume_id': 'a6220f09-dc37-4c0a-aa27-bc60bac7ffb1', 'auth_method': 'CHAP', 'auth_username': 'o4gsMKTu24GWUBBBt7AP', 'auth_password': 'Ab244SpR22ZP48Yt', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True} {{(pid=189076) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:17:52.220633 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:52.227927 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:17:52.229529 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[f92828a9-c332-4c80-93ba-41ef730774e8]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:17:52.229529 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:17:52.229529 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:17:52.229529 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:17:52.229529 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:17:52.229529 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:17:52.229529 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:17:52.229529 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:17:52.229529 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:17:52.229529 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:17:52.229529 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:17:52.229529 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:17:52.229529 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:17:52.229529 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:17:52.229529 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:17:52.229529 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:17:52.229529 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:17:52.229529 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:17:52.229529 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:17:52.229529 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:17:52.229529 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:17:52.229529 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:17:52.230680 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92828a9-c332-4c80-93ba-41ef730774e8]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:17:52.231679 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:17:52.232388 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:17:52.232833 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:17:52.235592 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:52.245540 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260" returned: 21 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:52.245859 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e66b3f-1a6c-4eda-a987-3bd98d6cf112]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:17:52.246599 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:17:52.246599 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:17:52.247880 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --interface default --op new {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:52.259599 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:52.259736 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcda7e7d-19f2-40bd-be49-5f33e491a9c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:17:52.260254 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1] added Jan 26 19:17:52.260254 np0005596550.novalocal nova-compute[189076]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:17:52.260254 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:17:52.260254 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:17:52.260254 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:17:52.260409 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=189076) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:17:52.260708 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.028(s), this was the 1st time calling it. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:17:52.260948 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:17:52.771566 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:52.954294 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-38a7d8fb-c558-4b1b-be8a-9801dca0652a tempest-VolumesActionsTest-1801349853 tempest-VolumesActionsTest-1801349853-project-member] Lock "7ab671bd-c50f-4726-b486-f24e9de9be75" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.512s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:53.262227 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:17:53.263471 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:53.274826 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:53.275114 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e08552-0e21-4808-b08b-d25fc5983cbd]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.name = iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.tpgt = -1 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.startup = automatic Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.leading_login = No Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.iscsi_ifacename = default Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.net_ifacename = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.ipaddress = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.prefix_len = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.hwaddress = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.transport_name = tcp Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.initiatorname = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.state = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.vlan_id = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.vlan_priority = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.vlan_state = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.iface_num = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.mtu = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.port = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.bootproto = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.subnet_mask = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.gateway = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id_state = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.dhcp_dns = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.dhcp_learn_iqn = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.dhcp_req_vendor_id_state = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id_state = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.dhcp_slp_da = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.fragmentation = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.gratuitous_arp = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.incoming_forwarding = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.tos_state = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.tos = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.ttl = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.delayed_ack = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.tcp_nagle = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf_state = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.tcp_timer_scale = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.tcp_timestamp = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.redirect = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.def_task_mgmt_timeout = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.header_digest = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.data_digest = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.immediate_data = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.initial_r2t = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.data_seq_inorder = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.data_pdu_inorder = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.erl = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.max_receive_data_len = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.first_burst_len = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.max_outstanding_r2t = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.max_burst_len = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.chap_auth = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.bidi_chap = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.strict_login_compliance = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.discovery_auth = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: iface.discovery_logout = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.discovery_address = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.discovery_port = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.discovery_type = fw Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.initial_cmdsn = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.initial_login_retry_max = 8 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.xmit_thread_priority = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.cmds_max = 128 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.queue_depth = 32 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.nr_sessions = 1 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.auth.authmethod = None Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.auth.username = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.auth.password = *** Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.auth.username_in = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.auth.password_in = Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.timeo.replacement_timeout = 120 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FastAbort = Yes Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.InitialR2T = No Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ImmediateData = Yes Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxConnections = 1 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ERL = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.scan = auto Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.reopen_max = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.session.conn_reopen_log_freq = 1 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.conn[0].address = 38.102.83.18 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.conn[0].port = 3260 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.conn[0].startup = manual Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.window_size = 524288 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.DataDigest = None Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.IFMarker = No Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.OFMarker = No Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: # END RECORD Jan 26 19:17:53.276919 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:17:53.278193 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:53.313309 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:53.313614 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[85800f5d-a29a-4a39-9843-b6970af4da34]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:17:53.314299 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:17:53.315586 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:53.325214 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:53.325460 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[3277d737-8c7a-4f14-88e9-2a8e292455e6]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:17:53.326016 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:17:53.327326 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v o4gsMKTu24GWUBBBt7AP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:53.351024 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v o4gsMKTu24GWUBBBt7AP" returned: 0 in 0.024s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:53.351336 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd088a8-fd7e-436c-a674-06abfc9ee09a]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:17:53.351827 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'o4gsMKTu24GWUBBBt7AP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:17:53.353310 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:53.365150 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:53.365932 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeba56d6-c432-4bc6-9549-89b13b1d6df0]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:17:53.366597 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:17:53.375957 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:53.386657 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:53.386953 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[89155c51-24c5-4ac5-9558-79f9bfe5bb5a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:17:53.387423 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jan 26 19:17:53.387423 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:17:53.387756 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jan 26 19:17:53.387756 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:17:53.388109 np0005596550.novalocal nova-compute[189076]: WARNING os_brick.initiator.connectors.iscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jan 26 19:17:53.388109 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:53.389243 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --login {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:53.408457 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --login" returned: 0 in 0.018s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:53.408457 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a53eebe-c674-4e7f-810f-46b7eab881be]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:17:53.408457 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1, portal: 38.102.83.18,3260] successful. Jan 26 19:17:53.408457 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:17:53.409799 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:53.420617 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:53.420826 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e158e84-c15e-4275-8608-8154f1ad9883]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:17:53.421274 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:17:53.422809 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:53.434182 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:53.434557 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[71672a55-5714-4bba-a786-655b56f40cca]: (4, ('tcp: [27] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:17:53.435157 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 (non-flash) Jan 26 19:17:53.435157 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:17:53.435468 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsi session list stdout=tcp: [27] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 (non-flash) Jan 26 19:17:53.435468 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:17:53.436096 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.204s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:17:53.436421 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Connected to 38.102.83.18:3260 {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:17:53.437290 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] HCTL ('2', '-', '-', 0) found on session 27 with lun 0 {{(pid=189076) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:17:53.437588 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Scanning host 2 c: -, t: -, l: 0) {{(pid=189076) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:17:53.439786 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host2/scan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:17:53.457692 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host2/scan" returned: 0 in 0.018s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:17:53.458016 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdfcada-baeb-4122-94e3-c0a9b6d51b9e]: (4, ('- - 0', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:17:53.459033 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Searching for a device in session 27 and hctl ['2', '*', '*', 0] yield: None {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:17:54.461064 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Searching for a device in session 27 and hctl ['2', '*', '*', 0] yield: sda {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:17:54.461844 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Connected to sda using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1', 'target_lun': 0, 'volume_id': 'a6220f09-dc37-4c0a-aa27-bc60bac7ffb1', 'auth_method': 'CHAP', 'auth_username': 'o4gsMKTu24GWUBBBt7AP', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True} {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:17:54.462739 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.244s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:17:54.463001 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] <== connect_volume: return (2245ms) {'type': 'block', 'scsi_wwn': '3600140598af16fed8194ab894ac6eb26', 'path': '/dev/sda'} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:17:54.463255 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3600140598af16fed8194ab894ac6eb26', 'path': '/dev/sda'} {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jan 26 19:17:54.467610 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'flavor' on Instance uuid 52b2c186-689c-4294-a2b4-d8b58f1a4cdb {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:17:54.974970 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] attach device xml: Jan 26 19:17:54.974970 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:54.974970 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:54.974970 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:54.974970 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:54.974970 np0005596550.novalocal nova-compute[189076]: a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 Jan 26 19:17:54.974970 np0005596550.novalocal nova-compute[189076]: Jan 26 19:17:54.974970 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:330}} Jan 26 19:17:56.578734 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:17:56.579388 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name vdb, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:17:56.581366 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:17:56.582862 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No VIF found with MAC fa:16:3e:ed:b9:00, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:17:57.772880 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:17:57.773621 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:57.773905 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:17:57.774095 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:17:57.774751 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:17:57.778474 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:17:58.538033 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-18c421c7-4624-45a3-b663-2d893cf8b251 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 10.535s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:17:58.890696 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Rescuing Jan 26 19:17:58.890696 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "refresh_cache-52b2c186-689c-4294-a2b4-d8b58f1a4cdb" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:17:58.890696 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquired lock "refresh_cache-52b2c186-689c-4294-a2b4-d8b58f1a4cdb" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:17:58.891450 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:17:59.396068 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:18:00.558261 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:18:00.664611 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Updating instance_info_cache with network_info: [{"id": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "address": "fa:16:3e:ed:b9:00", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96843dd0-63", "ovs_interfaceid": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:18:01.171191 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Releasing lock "refresh_cache-52b2c186-689c-4294-a2b4-d8b58f1a4cdb" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:18:02.217498 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:18:02.218298 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] VM Stopped (Lifecycle Event) Jan 26 19:18:02.722491 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79b4fda7-9c7c-4637-bde8-26b669492544 None None] [instance: 7ab671bd-c50f-4726-b486-f24e9de9be75] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:18:02.779303 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:18:02.798839 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:02.967584 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7bfbb86a-8960-45da-9841-d5e9dc99e250 req-b0b88de6-c7f2-40d5-a8dd-cedf66fec772 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received event network-vif-unplugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:18:02.967807 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7bfbb86a-8960-45da-9841-d5e9dc99e250 req-b0b88de6-c7f2-40d5-a8dd-cedf66fec772 service nova] Acquiring lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:18:02.969430 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7bfbb86a-8960-45da-9841-d5e9dc99e250 req-b0b88de6-c7f2-40d5-a8dd-cedf66fec772 service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:18:02.969939 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7bfbb86a-8960-45da-9841-d5e9dc99e250 req-b0b88de6-c7f2-40d5-a8dd-cedf66fec772 service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:18:02.970120 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7bfbb86a-8960-45da-9841-d5e9dc99e250 req-b0b88de6-c7f2-40d5-a8dd-cedf66fec772 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] No waiting events found dispatching network-vif-unplugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:18:02.970438 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-7bfbb86a-8960-45da-9841-d5e9dc99e250 req-b0b88de6-c7f2-40d5-a8dd-cedf66fec772 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received unexpected event network-vif-unplugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 for instance with vm_state active and task_state rescuing. Jan 26 19:18:02.973786 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:02.983212 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:03.071441 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Instance destroyed successfully. Jan 26 19:18:03.071777 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'numa_topology' on Instance uuid 52b2c186-689c-4294-a2b4-d8b58f1a4cdb {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:18:03.578997 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Attempting a stable device rescue Jan 26 19:18:03.670814 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=189076) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4599}} Jan 26 19:18:03.676532 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Instance directory exists: not creating {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5157}} Jan 26 19:18:03.676686 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Creating image(s) Jan 26 19:18:03.677242 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "/opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:18:03.677442 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:18:03.678038 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:18:03.678214 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'trusted_certs' on Instance uuid 52b2c186-689c-4294-a2b4-d8b58f1a4cdb {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:18:04.183345 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<52b2c186-689c-4294-a2b4-d8b58f1a4cdb> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:18:04.183345 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "21f203906098c75c1e3e244c2d345064ce29e81d" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:18:04.183506 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "21f203906098c75c1e3e244c2d345064ce29e81d" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:18:05.175795 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ee55d38a-fd9e-41ad-8003-0af3cd18f59a req-5d106b0f-8f7f-4b84-9c4c-849b427704a8 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received event network-vif-unplugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:18:05.175795 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ee55d38a-fd9e-41ad-8003-0af3cd18f59a req-5d106b0f-8f7f-4b84-9c4c-849b427704a8 service nova] Acquiring lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:18:05.175795 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ee55d38a-fd9e-41ad-8003-0af3cd18f59a req-5d106b0f-8f7f-4b84-9c4c-849b427704a8 service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:18:05.175795 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ee55d38a-fd9e-41ad-8003-0af3cd18f59a req-5d106b0f-8f7f-4b84-9c4c-849b427704a8 service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:18:05.175795 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ee55d38a-fd9e-41ad-8003-0af3cd18f59a req-5d106b0f-8f7f-4b84-9c4c-849b427704a8 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] No waiting events found dispatching network-vif-unplugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:18:05.175795 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-ee55d38a-fd9e-41ad-8003-0af3cd18f59a req-5d106b0f-8f7f-4b84-9c4c-849b427704a8 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received unexpected event network-vif-unplugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 for instance with vm_state active and task_state rescuing. Jan 26 19:18:05.842217 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:18:05.846969 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:18:05.847375 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21f203906098c75c1e3e244c2d345064ce29e81d.part --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:05.935566 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21f203906098c75c1e3e244c2d345064ce29e81d.part --force-share --output=json" returned: 0 in 0.088s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:05.935975 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.images [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] 8c20335b-a240-417b-a938-d5bd62f00e86 was qcow2, converting to raw {{(pid=189076) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jan 26 19:18:05.937022 np0005596550.novalocal nova-compute[189076]: DEBUG nova.privsep.utils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=189076) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jan 26 19:18:05.937186 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/21f203906098c75c1e3e244c2d345064ce29e81d.part /opt/stack/data/nova/instances/_base/21f203906098c75c1e3e244c2d345064ce29e81d.converted {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:06.637174 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/21f203906098c75c1e3e244c2d345064ce29e81d.part /opt/stack/data/nova/instances/_base/21f203906098c75c1e3e244c2d345064ce29e81d.converted" returned: 0 in 0.696s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:06.649908 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21f203906098c75c1e3e244c2d345064ce29e81d.converted --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:06.854508 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21f203906098c75c1e3e244c2d345064ce29e81d.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:06.855838 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "21f203906098c75c1e3e244c2d345064ce29e81d" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 2.672s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:18:06.856887 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:18:06.863653 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:18:06.865694 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "21f203906098c75c1e3e244c2d345064ce29e81d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:18:06.866357 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "21f203906098c75c1e3e244c2d345064ce29e81d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:18:06.866974 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:18:06.873382 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:18:06.874021 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21f203906098c75c1e3e244c2d345064ce29e81d --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:06.954720 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21f203906098c75c1e3e244c2d345064ce29e81d --force-share --output=json" returned: 0 in 0.080s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:06.955434 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21f203906098c75c1e3e244c2d345064ce29e81d,backing_fmt=raw /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk.rescue {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:07.432002 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21f203906098c75c1e3e244c2d345064ce29e81d,backing_fmt=raw /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk.rescue" returned: 0 in 0.475s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:07.432913 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "21f203906098c75c1e3e244c2d345064ce29e81d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.566s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:18:07.433747 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'migration_context' on Instance uuid 52b2c186-689c-4294-a2b4-d8b58f1a4cdb {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:18:07.857191 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:07.938279 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<52b2c186-689c-4294-a2b4-d8b58f1a4cdb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:18:07.938762 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:18:07.947046 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Start _get_guest_xml network_info=[{"id": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "address": "fa:16:3e:ed:b9:00", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "vif_mac": "fa:16:3e:ed:b9:00"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96843dd0-63", "ovs_interfaceid": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue={'image_id': '8c20335b-a240-417b-a938-d5bd62f00e86', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': 'a975d885-7597-433f-87a5-4862a00096f3', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1', 'target_lun': 0, 'volume_id': 'a6220f09-dc37-4c0a-aa27-bc60bac7ffb1', 'auth_method': 'CHAP', 'auth_username': 'o4gsMKTu24GWUBBBt7AP', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sda'}, 'status': 'reserved', 'instance': '52b2c186-689c-4294-a2b4-d8b58f1a4cdb', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6220f09-dc37-4c0a-aa27-bc60bac7ffb1', 'serial': 'a6220f09-dc37-4c0a-aa27-bc60bac7ffb1'}, 'boot_index': None, 'device_type': 'disk', 'volume_type': None}share_info=ShareMappingList(objects=[]) {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:18:07.947507 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'resources' on Instance uuid 52b2c186-689c-4294-a2b4-d8b58f1a4cdb {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:18:08.451334 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<52b2c186-689c-4294-a2b4-d8b58f1a4cdb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:18:08.456889 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:18:08.458412 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-1735980629', uuid='52b2c186-689c-4294-a2b4-d8b58f1a4cdb'), owner=OwnerMeta(userid='2724dd8bb624423083210013b9f090aa', username='tempest-ServerStableDeviceRescueTest-1891281471-project-member', projectid='819c3d68b8b1459bbf07574e4b01f715', projectname='tempest-ServerStableDeviceRescueTest-1891281471'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "address": "fa:16:3e:ed:b9:00", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "vif_mac": "fa:16:3e:ed:b9:00"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96843dd0-63", "ovs_interfaceid": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769473088.457943) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:18:08.460099 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:18:08.460532 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:18:08.461745 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:18:08.462355 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:18:08.463519 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:18:08.463999 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:18:08.464238 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:18:08.464417 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:18:08.464654 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:18:08.465006 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:18:08.465306 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:18:08.465534 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:18:08.465722 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:18:08.465944 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:18:08.466124 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:18:08.466309 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:18:08.466569 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'vcpu_model' on Instance uuid 52b2c186-689c-4294-a2b4-d8b58f1a4cdb {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:18:08.972993 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<52b2c186-689c-4294-a2b4-d8b58f1a4cdb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:18:08.979473 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk.config --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:09.076783 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk.config --force-share --output=json" returned: 0 in 0.097s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:09.077844 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "/opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:18:09.078298 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:18:09.079720 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "/opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:18:09.080369 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Calling os-brick to attach iSCSI Volume {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jan 26 19:18:09.082016 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1', 'target_lun': 0, 'volume_id': 'a6220f09-dc37-4c0a-aa27-bc60bac7ffb1', 'auth_method': 'CHAP', 'auth_username': 'o4gsMKTu24GWUBBBt7AP', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path'}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:18:09.082468 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:18:09.083150 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:18:09.083487 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1', 'target_lun': 0, 'volume_id': 'a6220f09-dc37-4c0a-aa27-bc60bac7ffb1', 'auth_method': 'CHAP', 'auth_username': 'o4gsMKTu24GWUBBBt7AP', 'auth_password': 'Ab244SpR22ZP48Yt', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sda'} {{(pid=189076) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:18:09.084968 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:09.093786 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:18:09.096571 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[103b02b2-5dc3-41bd-8d11-cdd281fe37f8]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:18:09.096571 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:18:09.096571 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:18:09.096571 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:18:09.096571 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:18:09.096571 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:18:09.096571 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:18:09.096571 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:18:09.096571 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:18:09.096571 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:18:09.096571 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:18:09.096571 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:18:09.096571 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:18:09.096571 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:18:09.096571 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:18:09.096571 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:18:09.096571 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:18:09.096571 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:18:09.096571 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:18:09.096571 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:18:09.096571 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:18:09.096571 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:18:09.124833 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[103b02b2-5dc3-41bd-8d11-cdd281fe37f8]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:18:09.125354 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:18:09.125752 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:18:09.126061 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:18:09.127191 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:09.142290 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260" returned: 0 in 0.015s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:09.142544 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ff8da1-7969-4de9-a3d9-27f08e74bbc3]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = o4gsMKTu24GWUBBBt7AP\nnode.session.auth.password = ********\nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.name = iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.tpgt = -1 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.startup = automatic Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.leading_login = No Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.iscsi_ifacename = default Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.net_ifacename = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.ipaddress = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.prefix_len = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.hwaddress = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.transport_name = tcp Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.initiatorname = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.state = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.vlan_id = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.vlan_priority = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.vlan_state = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.iface_num = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.mtu = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.port = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.bootproto = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.subnet_mask = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.gateway = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id_state = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.dhcp_dns = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.dhcp_learn_iqn = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.dhcp_req_vendor_id_state = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id_state = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.dhcp_slp_da = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.fragmentation = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.gratuitous_arp = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.incoming_forwarding = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.tos_state = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.tos = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.ttl = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.delayed_ack = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.tcp_nagle = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf_state = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.tcp_timer_scale = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.tcp_timestamp = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.redirect = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.def_task_mgmt_timeout = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.header_digest = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.data_digest = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.immediate_data = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.initial_r2t = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.data_seq_inorder = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.data_pdu_inorder = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.erl = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.max_receive_data_len = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.first_burst_len = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.max_outstanding_r2t = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.max_burst_len = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.chap_auth = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.bidi_chap = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.strict_login_compliance = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.discovery_auth = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: iface.discovery_logout = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.discovery_address = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.discovery_port = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.discovery_type = fw Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.initial_cmdsn = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.initial_login_retry_max = 8 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.xmit_thread_priority = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.cmds_max = 128 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.queue_depth = 32 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.nr_sessions = 1 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.auth.authmethod = CHAP Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.auth.username = o4gsMKTu24GWUBBBt7AP Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.auth.password = *** Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.auth.username_in = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.auth.password_in = Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.timeo.replacement_timeout = 120 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FastAbort = Yes Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.InitialR2T = No Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ImmediateData = Yes Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxConnections = 1 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ERL = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.scan = manual Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.reopen_max = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.session.conn_reopen_log_freq = 1 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.conn[0].address = 38.102.83.18 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.conn[0].port = 3260 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.conn[0].startup = manual Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.window_size = 524288 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.DataDigest = None Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.IFMarker = No Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.OFMarker = No Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: # END RECORD Jan 26 19:18:09.143849 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:18:09.145418 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:09.156916 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:09.157399 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[0104714b-514f-4d3c-b137-884893325639]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:18:09.157644 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:18:09.158599 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:09.173029 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.014s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:09.173478 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[716fa854-bbc3-4ab2-90d2-245f53e74e32]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:18:09.173859 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:18:09.175156 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v o4gsMKTu24GWUBBBt7AP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:09.187473 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v o4gsMKTu24GWUBBBt7AP" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:09.187947 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bff5b80-b494-44e2-971a-097948bbfc53]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:18:09.188326 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'o4gsMKTu24GWUBBBt7AP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:18:09.189562 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:09.202249 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:09.202637 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b068cfc-7455-4588-a4e1-16a37baf9b53]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:18:09.203168 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:18:09.204126 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:09.218019 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.014s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:09.218318 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[6274649f-3594-491c-ad61-9624631f143f]: (4, ('tcp: [27] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:18:09.218643 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 (non-flash) Jan 26 19:18:09.218643 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:18:09.218892 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsi session list stdout=tcp: [27] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 (non-flash) Jan 26 19:18:09.218892 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:18:09.219337 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.094s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:18:09.219529 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Connected to 38.102.83.18:3260 {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:18:09.220032 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] HCTL ('2', '0', '0', 0) found on session 27 with lun 0 {{(pid=189076) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:18:09.220206 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Scanning host 2 c: 0, t: 0, l: 0) {{(pid=189076) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:18:09.221021 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host2/scan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:09.230716 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host2/scan" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:09.230881 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd9395c-735e-427b-b3b3-f80128ba198b]: (4, ('0 0 0', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:18:09.231356 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Searching for a device in session 27 and hctl ('2', '0', '0', 0) yield: sda {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:18:09.231927 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Connected to sda using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1', 'target_lun': 0, 'volume_id': 'a6220f09-dc37-4c0a-aa27-bc60bac7ffb1', 'auth_method': 'CHAP', 'auth_username': 'o4gsMKTu24GWUBBBt7AP', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path'} {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:18:09.232417 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.149s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:18:09.232632 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] <== connect_volume: return (149ms) {'type': 'block', 'scsi_wwn': '3600140598af16fed8194ab894ac6eb26', 'path': '/dev/sda'} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:18:09.232870 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3600140598af16fed8194ab894ac6eb26', 'path': '/dev/sda'} {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jan 26 19:18:09.744865 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1735980629',display_name='tempest-ServerStableDeviceRescueTest-server-1735980629',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstabledevicerescuetest-server-1735980629',id=96,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHt4WbGf+VTDKkKrST6cvkAaeaHKLeinKi8WHzcR3edCWziVBKfCywnzFD79TXH96+KSKaQJIo/1lJNoPCmhSyJyCIQ+2JVjiS7zuVMily6lwqq9n64A6munflQahqUu6A==',key_name='tempest-keypair-134506363',keypairs=,launch_index=0,launched_at=2026-01-27T00:16:58Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='819c3d68b8b1459bbf07574e4b01f715',ramdisk_id='',reservation_id='r-0x86dze2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1891281471',owner_user_name='tempest-ServerStableDeviceRescueTest-1891281471-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:17:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2724dd8bb624423083210013b9f090aa',uuid=52b2c186-689c-4294-a2b4-d8b58f1a4cdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "address": "fa:16:3e:ed:b9:00", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "vif_mac": "fa:16:3e:ed:b9:00"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96843dd0-63", "ovs_interfaceid": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:18:09.745199 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converting VIF {"id": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "address": "fa:16:3e:ed:b9:00", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "vif_mac": "fa:16:3e:ed:b9:00"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96843dd0-63", "ovs_interfaceid": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:18:09.746313 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:b9:00,bridge_name='br-int',has_traffic_filtering=True,id=96843dd0-63a1-4a46-a52d-4514f5f72c58,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96843dd0-63') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:18:09.747363 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'pci_devices' on Instance uuid 52b2c186-689c-4294-a2b4-d8b58f1a4cdb {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:18:10.250944 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<52b2c186-689c-4294-a2b4-d8b58f1a4cdb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] End _get_guest_xml xml= Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: instance-00000060 Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-server-1735980629 Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:18:08 Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: ide Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: pc Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-1891281471-project-member Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: tempest-ServerStableDeviceRescueTest-1891281471 Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:10.255521 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:18:10.264501 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Instance destroyed successfully. Jan 26 19:18:11.790079 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:18:11.790597 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name vdb, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:18:11.790597 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name vdc, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:18:11.790597 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:18:11.790716 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] No VIF found with MAC fa:16:3e:ed:b9:00, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:18:11.791598 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Using config drive Jan 26 19:18:12.295243 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'ec2_ids' on Instance uuid 52b2c186-689c-4294-a2b4-d8b58f1a4cdb {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:18:12.802915 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<52b2c186-689c-4294-a2b4-d8b58f1a4cdb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:18:12.802915 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'keypairs' on Instance uuid 52b2c186-689c-4294-a2b4-d8b58f1a4cdb {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:18:12.858461 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:18:12.859697 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:18:12.859906 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:18:12.860077 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:18:12.898849 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:12.898849 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:18:13.307843 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<52b2c186-689c-4294-a2b4-d8b58f1a4cdb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:18:13.308336 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:18:13.397212 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Creating config drive at /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk.config.rescue Jan 26 19:18:13.400378 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpc4wtkhce {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:13.525302 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpc4wtkhce" returned: 0 in 0.125s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:13.598414 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:13.604559 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:13.624271 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:13.729572 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:13.913068 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4e563f31-b93b-43fa-99c8-1731362946f2 req-f8f4d6e9-6d7a-4c09-a152-3ac35668c777 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received event network-vif-plugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:18:13.914041 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4e563f31-b93b-43fa-99c8-1731362946f2 req-f8f4d6e9-6d7a-4c09-a152-3ac35668c777 service nova] Acquiring lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:18:13.914539 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4e563f31-b93b-43fa-99c8-1731362946f2 req-f8f4d6e9-6d7a-4c09-a152-3ac35668c777 service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:18:13.915003 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-4e563f31-b93b-43fa-99c8-1731362946f2 req-f8f4d6e9-6d7a-4c09-a152-3ac35668c777 service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:18:13.915427 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-4e563f31-b93b-43fa-99c8-1731362946f2 req-f8f4d6e9-6d7a-4c09-a152-3ac35668c777 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] No waiting events found dispatching network-vif-plugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:18:13.915912 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-4e563f31-b93b-43fa-99c8-1731362946f2 req-f8f4d6e9-6d7a-4c09-a152-3ac35668c777 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received unexpected event network-vif-plugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 for instance with vm_state active and task_state rescuing. Jan 26 19:18:14.193803 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for 52b2c186-689c-4294-a2b4-d8b58f1a4cdb due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:18:14.193803 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:18:14.193803 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] VM Resumed (Lifecycle Event) Jan 26 19:18:14.203981 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-e1b0b3c8-6f7c-43d2-b393-5e1a6706a9b7 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:18:14.697348 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:18:14.704960 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:18:15.212042 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:18:15.214672 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] VM Started (Lifecycle Event) Jan 26 19:18:15.722231 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:18:15.730258 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:18:15.846231 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-f7d0f9a6-f018-4c44-ad3b-60c932998435 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Unrescuing Jan 26 19:18:15.846796 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-f7d0f9a6-f018-4c44-ad3b-60c932998435 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "refresh_cache-52b2c186-689c-4294-a2b4-d8b58f1a4cdb" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:18:15.847200 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-f7d0f9a6-f018-4c44-ad3b-60c932998435 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquired lock "refresh_cache-52b2c186-689c-4294-a2b4-d8b58f1a4cdb" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:18:15.847609 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-f7d0f9a6-f018-4c44-ad3b-60c932998435 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:18:15.966663 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7d5a86c6-2c36-4da5-a6ac-368ced51197b req-d427c2bc-1b7f-4341-be41-3eb91dae6602 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received event network-vif-plugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:18:15.969991 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7d5a86c6-2c36-4da5-a6ac-368ced51197b req-d427c2bc-1b7f-4341-be41-3eb91dae6602 service nova] Acquiring lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:18:15.970399 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7d5a86c6-2c36-4da5-a6ac-368ced51197b req-d427c2bc-1b7f-4341-be41-3eb91dae6602 service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.003s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:18:15.970926 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-7d5a86c6-2c36-4da5-a6ac-368ced51197b req-d427c2bc-1b7f-4341-be41-3eb91dae6602 service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:18:15.971261 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-7d5a86c6-2c36-4da5-a6ac-368ced51197b req-d427c2bc-1b7f-4341-be41-3eb91dae6602 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] No waiting events found dispatching network-vif-plugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:18:15.972052 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-7d5a86c6-2c36-4da5-a6ac-368ced51197b req-d427c2bc-1b7f-4341-be41-3eb91dae6602 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received unexpected event network-vif-plugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 for instance with vm_state rescued and task_state unrescuing. Jan 26 19:18:16.233571 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] During sync_power_state the instance has a pending task (unrescuing). Skip. Jan 26 19:18:16.351503 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-f7d0f9a6-f018-4c44-ad3b-60c932998435 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:18:16.741810 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-f7d0f9a6-f018-4c44-ad3b-60c932998435 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:18:16.857954 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-f7d0f9a6-f018-4c44-ad3b-60c932998435 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Updating instance_info_cache with network_info: [{"id": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "address": "fa:16:3e:ed:b9:00", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96843dd0-63", "ovs_interfaceid": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:18:17.361055 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-f7d0f9a6-f018-4c44-ad3b-60c932998435 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Releasing lock "refresh_cache-52b2c186-689c-4294-a2b4-d8b58f1a4cdb" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:18:17.361622 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-f7d0f9a6-f018-4c44-ad3b-60c932998435 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'flavor' on Instance uuid 52b2c186-689c-4294-a2b4-d8b58f1a4cdb {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:18:17.891937 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:17.898709 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:18.021394 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:18.029059 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:18.040302 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d8ae93dc-688e-4c70-8d06-934f82c106f5 req-11c58570-7b9d-4ce0-86b3-53e13141b343 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received event network-changed-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:18:18.040513 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d8ae93dc-688e-4c70-8d06-934f82c106f5 req-11c58570-7b9d-4ce0-86b3-53e13141b343 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Refreshing instance network info cache due to event network-changed-96843dd0-63a1-4a46-a52d-4514f5f72c58. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:18:18.041232 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d8ae93dc-688e-4c70-8d06-934f82c106f5 req-11c58570-7b9d-4ce0-86b3-53e13141b343 service nova] Acquiring lock "refresh_cache-52b2c186-689c-4294-a2b4-d8b58f1a4cdb" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:18:18.041344 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d8ae93dc-688e-4c70-8d06-934f82c106f5 req-11c58570-7b9d-4ce0-86b3-53e13141b343 service nova] Acquired lock "refresh_cache-52b2c186-689c-4294-a2b4-d8b58f1a4cdb" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:18:18.041581 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-d8ae93dc-688e-4c70-8d06-934f82c106f5 req-11c58570-7b9d-4ce0-86b3-53e13141b343 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Refreshing network info cache for port 96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:18:18.109103 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:18.119081 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:18.197900 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Instance destroyed successfully. Jan 26 19:18:18.198553 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-f7d0f9a6-f018-4c44-ad3b-60c932998435 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'numa_topology' on Instance uuid 52b2c186-689c-4294-a2b4-d8b58f1a4cdb {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:18:18.281062 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:18.548794 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-d8ae93dc-688e-4c70-8d06-934f82c106f5 req-11c58570-7b9d-4ce0-86b3-53e13141b343 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:18:18.702354 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-f7d0f9a6-f018-4c44-ad3b-60c932998435 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Object Instance<52b2c186-689c-4294-a2b4-d8b58f1a4cdb> lazy-loaded attributes: flavor,numa_topology {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:18:18.783867 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:18.792759 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:18.819585 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-d8ae93dc-688e-4c70-8d06-934f82c106f5 req-11c58570-7b9d-4ce0-86b3-53e13141b343 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:18:18.988096 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:18.992852 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-d8ae93dc-688e-4c70-8d06-934f82c106f5 req-11c58570-7b9d-4ce0-86b3-53e13141b343 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Updated VIF entry in instance network info cache for port 96843dd0-63a1-4a46-a52d-4514f5f72c58. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:18:18.993143 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-d8ae93dc-688e-4c70-8d06-934f82c106f5 req-11c58570-7b9d-4ce0-86b3-53e13141b343 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Updating instance_info_cache with network_info: [{"id": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "address": "fa:16:3e:ed:b9:00", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96843dd0-63", "ovs_interfaceid": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:18:18.995054 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:19.043336 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for 52b2c186-689c-4294-a2b4-d8b58f1a4cdb due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:18:19.043981 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:18:19.044292 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] VM Resumed (Lifecycle Event) Jan 26 19:18:19.047213 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-f7d0f9a6-f018-4c44-ad3b-60c932998435 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:18:19.496269 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d8ae93dc-688e-4c70-8d06-934f82c106f5 req-11c58570-7b9d-4ce0-86b3-53e13141b343 service nova] Releasing lock "refresh_cache-52b2c186-689c-4294-a2b4-d8b58f1a4cdb" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:18:19.496429 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d8ae93dc-688e-4c70-8d06-934f82c106f5 req-11c58570-7b9d-4ce0-86b3-53e13141b343 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received event network-changed-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:18:19.496571 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d8ae93dc-688e-4c70-8d06-934f82c106f5 req-11c58570-7b9d-4ce0-86b3-53e13141b343 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Refreshing instance network info cache due to event network-changed-96843dd0-63a1-4a46-a52d-4514f5f72c58. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:18:19.496737 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d8ae93dc-688e-4c70-8d06-934f82c106f5 req-11c58570-7b9d-4ce0-86b3-53e13141b343 service nova] Acquiring lock "refresh_cache-52b2c186-689c-4294-a2b4-d8b58f1a4cdb" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:18:19.496869 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d8ae93dc-688e-4c70-8d06-934f82c106f5 req-11c58570-7b9d-4ce0-86b3-53e13141b343 service nova] Acquired lock "refresh_cache-52b2c186-689c-4294-a2b4-d8b58f1a4cdb" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:18:19.497003 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-d8ae93dc-688e-4c70-8d06-934f82c106f5 req-11c58570-7b9d-4ce0-86b3-53e13141b343 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Refreshing network info cache for port 96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:18:19.550048 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:18:19.552831 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:18:19.925157 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:20.000682 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-d8ae93dc-688e-4c70-8d06-934f82c106f5 req-11c58570-7b9d-4ce0-86b3-53e13141b343 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:18:20.058025 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:18:20.058256 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] VM Started (Lifecycle Event) Jan 26 19:18:20.115292 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received event network-vif-unplugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:18:20.115609 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] Acquiring lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:18:20.115963 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:18:20.116153 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:18:20.116342 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] No waiting events found dispatching network-vif-unplugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:18:20.116538 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received unexpected event network-vif-unplugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 for instance with vm_state active and task_state None. Jan 26 19:18:20.116728 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received event network-vif-unplugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:18:20.116931 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] Acquiring lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:18:20.117125 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:18:20.117299 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:18:20.117512 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] No waiting events found dispatching network-vif-unplugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:18:20.117752 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received unexpected event network-vif-unplugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 for instance with vm_state active and task_state None. Jan 26 19:18:20.118059 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received event network-vif-plugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:18:20.118287 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] Acquiring lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:18:20.118429 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:18:20.118748 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:18:20.119113 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] No waiting events found dispatching network-vif-plugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:18:20.119580 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received unexpected event network-vif-plugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 for instance with vm_state active and task_state None. Jan 26 19:18:20.119580 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received event network-vif-plugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:18:20.119646 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] Acquiring lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:18:20.119921 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:18:20.120119 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:18:20.120386 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] No waiting events found dispatching network-vif-plugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:18:20.120532 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-6d3657a0-05f8-4283-9ab1-956fdbd2bb4f req-51a408df-be4d-4fc9-ab4c-b62f25ab2d0e service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received unexpected event network-vif-plugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 for instance with vm_state active and task_state None. Jan 26 19:18:20.372140 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-d8ae93dc-688e-4c70-8d06-934f82c106f5 req-11c58570-7b9d-4ce0-86b3-53e13141b343 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:18:20.507666 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-d8ae93dc-688e-4c70-8d06-934f82c106f5 req-11c58570-7b9d-4ce0-86b3-53e13141b343 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Updated VIF entry in instance network info cache for port 96843dd0-63a1-4a46-a52d-4514f5f72c58. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:18:20.508013 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-d8ae93dc-688e-4c70-8d06-934f82c106f5 req-11c58570-7b9d-4ce0-86b3-53e13141b343 service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Updating instance_info_cache with network_info: [{"id": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "address": "fa:16:3e:ed:b9:00", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96843dd0-63", "ovs_interfaceid": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:18:20.562288 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:18:20.568894 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:18:21.011409 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d8ae93dc-688e-4c70-8d06-934f82c106f5 req-11c58570-7b9d-4ce0-86b3-53e13141b343 service nova] Releasing lock "refresh_cache-52b2c186-689c-4294-a2b4-d8b58f1a4cdb" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:18:22.896448 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:18:22.950667 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:23.283686 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:23.895737 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:18:23.896127 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:18:24.406151 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:18:24.406151 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:18:24.407234 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:18:24.407234 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:18:25.454949 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:25.558307 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:25.559257 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:25.627273 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json" returned: 0 in 0.067s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:25.635846 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:25.704495 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk --force-share --output=json" returned: 0 in 0.069s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:25.705602 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:25.811345 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:25.818204 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:25.922543 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:25.923344 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:25.997804 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d/disk --force-share --output=json" returned: 0 in 0.073s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:26.005520 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:26.117828 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:26.117828 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:26.191974 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb/disk --force-share --output=json" returned: 0 in 0.074s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:26.192838 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] skipping disk /dev/sda (vdb) as it is a volume {{(pid=189076) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12209}} Jan 26 19:18:26.354815 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:18:26.354815 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:26.383940 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.030s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:26.384655 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=6558MB free_disk=371.6617736816406GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:18:26.385131 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:18:26.385528 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:18:27.478725 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 4b54d0fc-613e-4ce1-8ba9-54651f4079bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:18:27.479307 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 26e2c1ab-94b1-4731-afc4-9c987e187c8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:18:27.479307 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 0832d494-61af-4cf9-86e6-3a0293b8f09d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:18:27.479523 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 52b2c186-689c-4294-a2b4-d8b58f1a4cdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:18:27.480014 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 4 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:18:27.480436 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=1280MB phys_disk=399GB used_disk=4GB total_vcpus=8 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:18:26 up 46 min, 13 users, load average: 4.51, 4.95, 4.42\n', 'num_instances': '4', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '4', 'num_proj_819c3d68b8b1459bbf07574e4b01f715': '4', 'io_workload': '0'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:18:27.675102 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:18:28.001227 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:28.179750 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:18:28.284213 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:28.687808 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:18:28.689085 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.303s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:18:33.004048 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:33.689592 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:18:33.689830 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:18:33.689891 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:18:33.893818 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:18:33.895825 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:18:33.896125 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:18:38.005960 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:18:38.007722 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:18:38.007947 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:18:38.008195 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:18:38.060229 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:38.060486 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:18:38.285963 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:43.060728 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:43.289867 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:48.103288 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:48.290361 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:53.029115 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:18:53.029654 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:18:53.105256 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:53.335554 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:53.534694 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Detaching volume a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 Jan 26 19:18:53.595835 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.block_device [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Attempting to driver detach volume a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 from mountpoint /dev/vdb Jan 26 19:18:53.627421 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Found disk vdb by alias ua-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:18:53.629356 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Found disk vdb by alias ua-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:18:53.629572 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Attempting to detach device vdb from instance 52b2c186-689c-4294-a2b4-d8b58f1a4cdb from the persistent domain config. {{(pid=189076) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2599}} Jan 26 19:18:53.630085 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] detach device xml: Jan 26 19:18:53.630085 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:53.630085 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:53.630085 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:53.630085 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:53.630085 np0005596550.novalocal nova-compute[189076]: a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 Jan 26 19:18:53.630085 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:18:53.630085 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:53.630085 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:18:53.643895 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Found disk vdb by alias ua-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:18:53.644120 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Failed to detach device vdb from instance 52b2c186-689c-4294-a2b4-d8b58f1a4cdb from the persistent domain config. Libvirt did not report any error but the device is still in the config. Jan 26 19:18:53.644401 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] (1/8): Attempting to detach device vdb with device alias ua-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 from instance 52b2c186-689c-4294-a2b4-d8b58f1a4cdb from the live domain config. {{(pid=189076) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2633}} Jan 26 19:18:53.644939 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] detach device xml: Jan 26 19:18:53.644939 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:53.644939 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:53.644939 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:53.644939 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:53.644939 np0005596550.novalocal nova-compute[189076]: a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 Jan 26 19:18:53.644939 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:18:53.644939 np0005596550.novalocal nova-compute[189076]: Jan 26 19:18:53.644939 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:18:53.781589 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Received event ua-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1> from libvirt while the driver is waiting for it; dispatched. {{(pid=189076) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2486}} Jan 26 19:18:53.782893 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 for instance 52b2c186-689c-4294-a2b4-d8b58f1a4cdb {{(pid=189076) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2713}} Jan 26 19:18:53.786146 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Successfully detached device vdb from instance 52b2c186-689c-4294-a2b4-d8b58f1a4cdb from the live domain config. Jan 26 19:18:53.791272 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] calling os-brick to detach iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jan 26 19:18:53.792239 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1', 'target_lun': 0, 'volume_id': 'a6220f09-dc37-4c0a-aa27-bc60bac7ffb1', 'auth_method': 'CHAP', 'auth_username': 'o4gsMKTu24GWUBBBt7AP', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sda'}, None), 'kwargs': False}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:18:53.792438 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:18:53.792992 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:18:53.794501 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:53.810989 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.016s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:53.811178 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9b5778-418a-4721-b894-2f9942939278]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:18:53.811644 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:18:53.811644 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:18:53.811644 np0005596550.novalocal nova-compute[189076]: iSNS: Jan 26 19:18:53.811644 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:18:53.811644 np0005596550.novalocal nova-compute[189076]: STATIC: Jan 26 19:18:53.811644 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 Jan 26 19:18:53.811644 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:18:53.811644 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:18:53.811644 np0005596550.novalocal nova-compute[189076]: FIRMWARE: Jan 26 19:18:53.811644 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:18:53.811644 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:18:53.811811 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:18:53.811811 np0005596550.novalocal nova-compute[189076]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:18:53.811811 np0005596550.novalocal nova-compute[189076]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=189076) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:18:53.812093 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1', 0)] {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:18:53.816798 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:53.831708 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:53.831876 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab325b86-df68-4b99-abd2-363e6bc02797]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:18:53.833281 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:53.853482 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:53.853635 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f72cbc-b5af-48d9-ad5e-7dc5e4c9137e]: (4, ('tcp: [27] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:18:53.854423 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 (non-flash) Jan 26 19:18:53.854423 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:18:53.855286 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsi session list stdout=tcp: [27] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 (non-flash) Jan 26 19:18:53.855286 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:18:53.856440 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Resulting device map defaultdict(. at 0x7fd768097ec0>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1'): ({'sda'}, set())}) {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:18:53.857066 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Removing single pathed devices sda {{(pid=189076) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:18:53.859518 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:53.870602 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:18:53.873355 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[a5cc747e-a554-4277-b667-6c6d4765c128]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:18:53.873355 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:18:53.873355 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:18:53.873355 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:18:53.873355 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:18:53.873355 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:18:53.873355 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:18:53.873355 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:18:53.873355 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:18:53.873355 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:18:53.873355 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:18:53.873355 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:18:53.873355 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:18:53.873355 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:18:53.873355 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:18:53.873355 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:18:53.873355 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:18:53.873355 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:18:53.873355 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:18:53.873355 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:18:53.873355 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:18:53.873355 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:18:53.876158 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cc747e-a554-4277-b667-6c6d4765c128]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:18:53.876876 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Flushing IO for device /dev/sda {{(pid=189076) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:18:53.877891 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sda {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:53.889912 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sda" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:53.890084 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3d8baa-6d49-43dd-ab5b-231759b0d349]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:18:53.890611 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Remove SCSI device /dev/sda with /sys/block/sda/device/delete {{(pid=189076) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:18:53.892007 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sda/device/delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:53.966558 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sda/device/delete" returned: 0 in 0.074s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:53.967185 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54c4e2c-d4e9-4447-b227-d94c56784226]: (4, ('1', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:18:53.967710 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Checking to see if SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:18:53.968131 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:18:53.968597 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1')] {{(pid=189076) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:18:53.970044 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:53.984533 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:53.984739 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[0622e392-2e30-45c6-b0c1-f252a523834c]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:18:53.985267 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:18:53.987342 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --logout {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:54.017515 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --logout" returned: 0 in 0.031s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:54.017674 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[458ecdac-d8fd-4869-b478-32503381a1f2]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1, portal: 38.102.83.18,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:18:54.018096 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1, portal: 38.102.83.18,3260] Jan 26 19:18:54.018096 np0005596550.novalocal nova-compute[189076]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1, portal: 38.102.83.18,3260] successful. Jan 26 19:18:54.018096 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:18:54.019018 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --op delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:18:54.029389 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a6220f09-dc37-4c0a-aa27-bc60bac7ffb1 -p 38.102.83.18:3260 --op delete" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:18:54.029813 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[66044d51-93e8-4317-9a43-10fb80f4c493]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:18:54.029948 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:18:54.030234 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.237s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:18:54.030399 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] <== disconnect_volume: return (237ms) None {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:18:54.030568 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Disconnected iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jan 26 19:18:57.579499 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'flavor' on Instance uuid 52b2c186-689c-4294-a2b4-d8b58f1a4cdb {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:18:58.108208 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:18:58.589103 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0ac2c3c7-d7ed-4672-ab2e-34b39df6e8eb tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 5.559s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:00.220106 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:00.220454 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:00.220529 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:00.220688 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:00.222085 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:00.225701 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Terminating instance Jan 26 19:19:00.732392 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:19:00.788901 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:00.794065 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:00.796267 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:00.952338 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:00.961266 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:00.973304 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-549bfb30-3732-47ad-9d05-7e9778b39270 req-596c7b37-3635-461c-83d7-eafd974518bd service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received event network-vif-unplugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:19:00.973499 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-549bfb30-3732-47ad-9d05-7e9778b39270 req-596c7b37-3635-461c-83d7-eafd974518bd service nova] Acquiring lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:00.973682 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-549bfb30-3732-47ad-9d05-7e9778b39270 req-596c7b37-3635-461c-83d7-eafd974518bd service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:00.973864 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-549bfb30-3732-47ad-9d05-7e9778b39270 req-596c7b37-3635-461c-83d7-eafd974518bd service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:00.973989 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-549bfb30-3732-47ad-9d05-7e9778b39270 req-596c7b37-3635-461c-83d7-eafd974518bd service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] No waiting events found dispatching network-vif-unplugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:19:00.974145 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-549bfb30-3732-47ad-9d05-7e9778b39270 req-596c7b37-3635-461c-83d7-eafd974518bd service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received event network-vif-unplugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:19:01.024352 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Instance destroyed successfully. Jan 26 19:19:01.024749 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'resources' on Instance uuid 52b2c186-689c-4294-a2b4-d8b58f1a4cdb {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:19:01.529044 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1735980629',display_name='tempest-ServerStableDeviceRescueTest-server-1735980629',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstabledevicerescuetest-server-1735980629',id=96,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHt4WbGf+VTDKkKrST6cvkAaeaHKLeinKi8WHzcR3edCWziVBKfCywnzFD79TXH96+KSKaQJIo/1lJNoPCmhSyJyCIQ+2JVjiS7zuVMily6lwqq9n64A6munflQahqUu6A==',key_name='tempest-keypair-134506363',keypairs=,launch_index=0,launched_at=2026-01-27T00:18:14Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='819c3d68b8b1459bbf07574e4b01f715',ramdisk_id='',reservation_id='r-0x86dze2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1891281471',owner_user_name='tempest-ServerStableDeviceRescueTest-1891281471-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:18:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2724dd8bb624423083210013b9f090aa',uuid=52b2c186-689c-4294-a2b4-d8b58f1a4cdb,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "address": "fa:16:3e:ed:b9:00", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96843dd0-63", "ovs_interfaceid": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:19:01.529662 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converting VIF {"id": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "address": "fa:16:3e:ed:b9:00", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96843dd0-63", "ovs_interfaceid": "96843dd0-63a1-4a46-a52d-4514f5f72c58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:19:01.530280 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:b9:00,bridge_name='br-int',has_traffic_filtering=True,id=96843dd0-63a1-4a46-a52d-4514f5f72c58,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96843dd0-63') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:19:01.530727 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:b9:00,bridge_name='br-int',has_traffic_filtering=True,id=96843dd0-63a1-4a46-a52d-4514f5f72c58,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96843dd0-63') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:19:01.532662 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:01.533032 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96843dd0-63, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:19:01.534482 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:01.536735 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:19:01.537580 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:01.537842 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0cb345a4-5130-4265-ba50-016d8e09503d) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:19:01.538703 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:01.540115 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:01.543070 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:b9:00,bridge_name='br-int',has_traffic_filtering=True,id=96843dd0-63a1-4a46-a52d-4514f5f72c58,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96843dd0-63') Jan 26 19:19:01.543400 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Deleting instance files /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb_del Jan 26 19:19:01.544032 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Deletion of /opt/stack/data/nova/instances/52b2c186-689c-4294-a2b4-d8b58f1a4cdb_del complete Jan 26 19:19:02.060053 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Took 1.33 seconds to destroy the instance on the hypervisor. Jan 26 19:19:02.060603 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:19:02.061026 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:19:02.061234 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:19:02.061772 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:19:02.130449 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:19:03.027588 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3047d91b-4abb-4155-9207-53847e67d7ee req-7e58468c-d2ac-46a8-9e37-f6555d496c6a service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received event network-vif-unplugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:19:03.028316 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3047d91b-4abb-4155-9207-53847e67d7ee req-7e58468c-d2ac-46a8-9e37-f6555d496c6a service nova] Acquiring lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:03.028316 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3047d91b-4abb-4155-9207-53847e67d7ee req-7e58468c-d2ac-46a8-9e37-f6555d496c6a service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:03.028316 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3047d91b-4abb-4155-9207-53847e67d7ee req-7e58468c-d2ac-46a8-9e37-f6555d496c6a service nova] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:03.029376 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3047d91b-4abb-4155-9207-53847e67d7ee req-7e58468c-d2ac-46a8-9e37-f6555d496c6a service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] No waiting events found dispatching network-vif-unplugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:19:03.029376 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3047d91b-4abb-4155-9207-53847e67d7ee req-7e58468c-d2ac-46a8-9e37-f6555d496c6a service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received event network-vif-unplugged-96843dd0-63a1-4a46-a52d-4514f5f72c58 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:19:03.029376 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3047d91b-4abb-4155-9207-53847e67d7ee req-7e58468c-d2ac-46a8-9e37-f6555d496c6a service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Received event network-vif-deleted-96843dd0-63a1-4a46-a52d-4514f5f72c58 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:19:03.029376 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-3047d91b-4abb-4155-9207-53847e67d7ee req-7e58468c-d2ac-46a8-9e37-f6555d496c6a service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Neutron deleted interface 96843dd0-63a1-4a46-a52d-4514f5f72c58; detaching it from the instance and deleting it from the info cache Jan 26 19:19:03.029376 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-3047d91b-4abb-4155-9207-53847e67d7ee req-7e58468c-d2ac-46a8-9e37-f6555d496c6a service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:19:03.117930 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:19:03.535613 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3047d91b-4abb-4155-9207-53847e67d7ee req-7e58468c-d2ac-46a8-9e37-f6555d496c6a service nova] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Detach interface failed, port_id=96843dd0-63a1-4a46-a52d-4514f5f72c58, reason: Instance 52b2c186-689c-4294-a2b4-d8b58f1a4cdb could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:19:03.621826 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Took 1.56 seconds to deallocate network for instance. Jan 26 19:19:04.132920 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:04.133423 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:04.337228 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:19:04.840962 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:19:05.348601 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.215s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:05.405499 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Deleted allocations for instance 52b2c186-689c-4294-a2b4-d8b58f1a4cdb Jan 26 19:19:06.416450 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-45335c9d-85ca-45d9-9f51-a4dfb8c7f8d3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "52b2c186-689c-4294-a2b4-d8b58f1a4cdb" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.196s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:06.540866 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:09.557067 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:11.250835 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "0832d494-61af-4cf9-86e6-3a0293b8f09d" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:11.251273 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:11.251273 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:11.251472 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:11.251689 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:11.254289 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Terminating instance Jan 26 19:19:11.542001 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:11.759612 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:19:11.785937 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:11.793653 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:11.949307 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:11.955799 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:11.964591 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f6ff2a6d-5d36-4d51-bac5-4fcd1e44131d req-3bb662f0-9c90-4f0b-afb5-61358eb26b22 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received event network-vif-unplugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:19:11.965065 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f6ff2a6d-5d36-4d51-bac5-4fcd1e44131d req-3bb662f0-9c90-4f0b-afb5-61358eb26b22 service nova] Acquiring lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:11.965579 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f6ff2a6d-5d36-4d51-bac5-4fcd1e44131d req-3bb662f0-9c90-4f0b-afb5-61358eb26b22 service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:11.966032 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f6ff2a6d-5d36-4d51-bac5-4fcd1e44131d req-3bb662f0-9c90-4f0b-afb5-61358eb26b22 service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:11.966412 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f6ff2a6d-5d36-4d51-bac5-4fcd1e44131d req-3bb662f0-9c90-4f0b-afb5-61358eb26b22 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] No waiting events found dispatching network-vif-unplugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:19:11.966743 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f6ff2a6d-5d36-4d51-bac5-4fcd1e44131d req-3bb662f0-9c90-4f0b-afb5-61358eb26b22 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received event network-vif-unplugged-8efef1f6-1c33-4112-a281-960b409908c8 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:19:12.002446 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:12.041846 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Instance destroyed successfully. Jan 26 19:19:12.042405 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'resources' on Instance uuid 0832d494-61af-4cf9-86e6-3a0293b8f09d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:19:12.547334 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:16:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-239032308',display_name='tempest-ServerStableDeviceRescueTest-server-239032308',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstabledevicerescuetest-server-239032308',id=95,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:16:38Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='819c3d68b8b1459bbf07574e4b01f715',ramdisk_id='',reservation_id='r-lrtvn96e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1891281471',owner_user_name='tempest-ServerStableDeviceRescueTest-1891281471-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:16:43Z,user_data=None,user_id='2724dd8bb624423083210013b9f090aa',uuid=0832d494-61af-4cf9-86e6-3a0293b8f09d,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8efef1f6-1c33-4112-a281-960b409908c8", "address": "fa:16:3e:21:ab:44", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efef1f6-1c", "ovs_interfaceid": "8efef1f6-1c33-4112-a281-960b409908c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:19:12.548139 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converting VIF {"id": "8efef1f6-1c33-4112-a281-960b409908c8", "address": "fa:16:3e:21:ab:44", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8efef1f6-1c", "ovs_interfaceid": "8efef1f6-1c33-4112-a281-960b409908c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:19:12.548829 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:ab:44,bridge_name='br-int',has_traffic_filtering=True,id=8efef1f6-1c33-4112-a281-960b409908c8,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8efef1f6-1c') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:19:12.549477 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:ab:44,bridge_name='br-int',has_traffic_filtering=True,id=8efef1f6-1c33-4112-a281-960b409908c8,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8efef1f6-1c') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:19:12.551676 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:12.552526 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8efef1f6-1c, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:19:12.554506 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:12.557180 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:12.558935 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:12.559449 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ccfb3fbc-e096-41b6-ae59-4e1f65c9f36e) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:19:12.560506 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:12.562738 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:12.566312 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:ab:44,bridge_name='br-int',has_traffic_filtering=True,id=8efef1f6-1c33-4112-a281-960b409908c8,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8efef1f6-1c') Jan 26 19:19:12.566838 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Deleting instance files /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d_del Jan 26 19:19:12.567748 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Deletion of /opt/stack/data/nova/instances/0832d494-61af-4cf9-86e6-3a0293b8f09d_del complete Jan 26 19:19:13.080039 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Took 1.32 seconds to destroy the instance on the hypervisor. Jan 26 19:19:13.080677 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:19:13.081071 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:19:13.081237 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:19:13.081592 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:19:13.161803 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:19:13.961074 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:19:14.042796 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c61afa93-edca-47d2-9c08-e069171bd359 req-40cdf949-ded1-4ee4-af25-dde0ebff71e1 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received event network-vif-unplugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:19:14.043229 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c61afa93-edca-47d2-9c08-e069171bd359 req-40cdf949-ded1-4ee4-af25-dde0ebff71e1 service nova] Acquiring lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:14.043611 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c61afa93-edca-47d2-9c08-e069171bd359 req-40cdf949-ded1-4ee4-af25-dde0ebff71e1 service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:14.043956 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c61afa93-edca-47d2-9c08-e069171bd359 req-40cdf949-ded1-4ee4-af25-dde0ebff71e1 service nova] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:14.044256 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c61afa93-edca-47d2-9c08-e069171bd359 req-40cdf949-ded1-4ee4-af25-dde0ebff71e1 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] No waiting events found dispatching network-vif-unplugged-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:19:14.044553 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c61afa93-edca-47d2-9c08-e069171bd359 req-40cdf949-ded1-4ee4-af25-dde0ebff71e1 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received event network-vif-unplugged-8efef1f6-1c33-4112-a281-960b409908c8 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:19:14.044976 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c61afa93-edca-47d2-9c08-e069171bd359 req-40cdf949-ded1-4ee4-af25-dde0ebff71e1 service nova] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Received event network-vif-deleted-8efef1f6-1c33-4112-a281-960b409908c8 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:19:14.464745 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Took 1.38 seconds to deallocate network for instance. Jan 26 19:19:14.975584 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:14.976055 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:15.138329 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:19:15.643183 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:19:16.021814 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:19:16.022379 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] VM Stopped (Lifecycle Event) Jan 26 19:19:16.150578 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.174s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:16.203821 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Deleted allocations for instance 0832d494-61af-4cf9-86e6-3a0293b8f09d Jan 26 19:19:16.526805 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3ce1b66d-e231-4f23-8447-aea6667bb251 None None] [instance: 52b2c186-689c-4294-a2b4-d8b58f1a4cdb] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:19:17.217853 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-1b9f27ef-ae00-41c0-bf9e-17897fa4e9c5 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "0832d494-61af-4cf9-86e6-3a0293b8f09d" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 5.966s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:17.561720 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:19.025530 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:19.025977 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:19.025977 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:19.026220 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:19.026426 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:19.031109 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Terminating instance Jan 26 19:19:19.535578 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:19:19.583638 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:19.584843 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:19.586401 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:19.695084 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:19.699996 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:19.719718 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-29061d4e-e5df-4196-a091-8f75cd51e108 req-9f5f5e9d-168d-46de-9f50-0f2c53aec3b3 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received event network-vif-unplugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:19:19.719960 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-29061d4e-e5df-4196-a091-8f75cd51e108 req-9f5f5e9d-168d-46de-9f50-0f2c53aec3b3 service nova] Acquiring lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:19.720139 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-29061d4e-e5df-4196-a091-8f75cd51e108 req-9f5f5e9d-168d-46de-9f50-0f2c53aec3b3 service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:19.720291 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-29061d4e-e5df-4196-a091-8f75cd51e108 req-9f5f5e9d-168d-46de-9f50-0f2c53aec3b3 service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:19.720448 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-29061d4e-e5df-4196-a091-8f75cd51e108 req-9f5f5e9d-168d-46de-9f50-0f2c53aec3b3 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] No waiting events found dispatching network-vif-unplugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:19:19.720618 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-29061d4e-e5df-4196-a091-8f75cd51e108 req-9f5f5e9d-168d-46de-9f50-0f2c53aec3b3 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received event network-vif-unplugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:19:19.790752 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Instance destroyed successfully. Jan 26 19:19:19.791222 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'resources' on Instance uuid 26e2c1ab-94b1-4731-afc4-9c987e187c8d {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:19:20.295635 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-844896935',display_name='tempest-ServerStableDeviceRescueTest-server-844896935',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstabledevicerescuetest-server-844896935',id=94,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:15:57Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='819c3d68b8b1459bbf07574e4b01f715',ramdisk_id='',reservation_id='r-yocl0nfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1891281471',owner_user_name='tempest-ServerStableDeviceRescueTest-1891281471-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:16:02Z,user_data=None,user_id='2724dd8bb624423083210013b9f090aa',uuid=26e2c1ab-94b1-4731-afc4-9c987e187c8d,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "address": "fa:16:3e:21:d5:2c", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd0122a-d9", "ovs_interfaceid": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:19:20.296399 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converting VIF {"id": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "address": "fa:16:3e:21:d5:2c", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd0122a-d9", "ovs_interfaceid": "fdd0122a-d9ce-48b0-9f2c-156c89334d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:19:20.297435 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:d5:2c,bridge_name='br-int',has_traffic_filtering=True,id=fdd0122a-d9ce-48b0-9f2c-156c89334d0b,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd0122a-d9') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:19:20.298013 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:d5:2c,bridge_name='br-int',has_traffic_filtering=True,id=fdd0122a-d9ce-48b0-9f2c-156c89334d0b,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd0122a-d9') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:19:20.299714 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:20.300252 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfdd0122a-d9, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:19:20.302950 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:20.306335 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:19:20.307442 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:20.307873 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e1f5c7a-c89a-4305-8474-858acc647f40) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:19:20.309273 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:20.310718 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:20.314026 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:d5:2c,bridge_name='br-int',has_traffic_filtering=True,id=fdd0122a-d9ce-48b0-9f2c-156c89334d0b,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd0122a-d9') Jan 26 19:19:20.314675 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Deleting instance files /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d_del Jan 26 19:19:20.315590 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Deletion of /opt/stack/data/nova/instances/26e2c1ab-94b1-4731-afc4-9c987e187c8d_del complete Jan 26 19:19:20.828310 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Took 1.29 seconds to destroy the instance on the hypervisor. Jan 26 19:19:20.828848 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:19:20.829293 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:19:20.829489 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:19:20.830030 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:19:20.896426 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:19:20.912797 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:19:21.243723 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-23e6e47a-f842-417d-a0f7-bf8a35c94595 req-a31da467-5547-41dd-9725-9467b8218cd5 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received event network-vif-deleted-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:19:21.243884 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-23e6e47a-f842-417d-a0f7-bf8a35c94595 req-a31da467-5547-41dd-9725-9467b8218cd5 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Neutron deleted interface fdd0122a-d9ce-48b0-9f2c-156c89334d0b; detaching it from the instance and deleting it from the info cache Jan 26 19:19:21.244034 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-23e6e47a-f842-417d-a0f7-bf8a35c94595 req-a31da467-5547-41dd-9725-9467b8218cd5 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:19:21.704284 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:19:21.751938 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-fa948c5c-7c6c-4ae3-adcb-5774e721bb81 req-bd66da56-4af0-4d06-bffc-f9f82719cc40 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received event network-vif-unplugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:19:21.752345 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fa948c5c-7c6c-4ae3-adcb-5774e721bb81 req-bd66da56-4af0-4d06-bffc-f9f82719cc40 service nova] Acquiring lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:21.752683 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fa948c5c-7c6c-4ae3-adcb-5774e721bb81 req-bd66da56-4af0-4d06-bffc-f9f82719cc40 service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:21.753019 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-fa948c5c-7c6c-4ae3-adcb-5774e721bb81 req-bd66da56-4af0-4d06-bffc-f9f82719cc40 service nova] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:21.753312 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-fa948c5c-7c6c-4ae3-adcb-5774e721bb81 req-bd66da56-4af0-4d06-bffc-f9f82719cc40 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] No waiting events found dispatching network-vif-unplugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:19:21.753604 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-fa948c5c-7c6c-4ae3-adcb-5774e721bb81 req-bd66da56-4af0-4d06-bffc-f9f82719cc40 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Received event network-vif-unplugged-fdd0122a-d9ce-48b0-9f2c-156c89334d0b for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:19:21.754959 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-23e6e47a-f842-417d-a0f7-bf8a35c94595 req-a31da467-5547-41dd-9725-9467b8218cd5 service nova] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Detach interface failed, port_id=fdd0122a-d9ce-48b0-9f2c-156c89334d0b, reason: Instance 26e2c1ab-94b1-4731-afc4-9c987e187c8d could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:19:22.208424 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Took 1.38 seconds to deallocate network for instance. Jan 26 19:19:22.716463 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:22.717247 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:22.830376 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:19:23.334449 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:19:23.843672 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.127s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:24.012856 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Deleted allocations for instance 26e2c1ab-94b1-4731-afc4-9c987e187c8d Jan 26 19:19:24.399786 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:19:24.400151 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:19:24.400414 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Cleaning up deleted instances {{(pid=189076) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11960}} Jan 26 19:19:24.904209 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] There are 0 instances to clean {{(pid=189076) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11969}} Jan 26 19:19:25.023295 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c683fc7c-0471-4ba2-be07-3c2bc2f00063 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "26e2c1ab-94b1-4731-afc4-9c987e187c8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 5.997s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:25.309562 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:25.400170 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:19:25.895655 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:19:26.366882 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:26.366882 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:26.366882 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:26.366882 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:26.366882 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:26.369178 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Terminating instance Jan 26 19:19:26.402420 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:26.402798 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:26.403197 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:26.403447 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:19:26.873655 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:19:26.899483 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:26.910600 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:26.931855 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:26.943951 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:27.036742 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-75f91067-9ff9-458f-9205-bdf79291b329 req-0b6f918f-190a-4b89-ae9b-4ff9bd7ab1f6 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received event network-vif-unplugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:19:27.037011 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-75f91067-9ff9-458f-9205-bdf79291b329 req-0b6f918f-190a-4b89-ae9b-4ff9bd7ab1f6 service nova] Acquiring lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:27.039504 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-75f91067-9ff9-458f-9205-bdf79291b329 req-0b6f918f-190a-4b89-ae9b-4ff9bd7ab1f6 service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:27.039504 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-75f91067-9ff9-458f-9205-bdf79291b329 req-0b6f918f-190a-4b89-ae9b-4ff9bd7ab1f6 service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:27.039504 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-75f91067-9ff9-458f-9205-bdf79291b329 req-0b6f918f-190a-4b89-ae9b-4ff9bd7ab1f6 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] No waiting events found dispatching network-vif-unplugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:19:27.039504 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-75f91067-9ff9-458f-9205-bdf79291b329 req-0b6f918f-190a-4b89-ae9b-4ff9bd7ab1f6 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received event network-vif-unplugged-eb474507-4ff1-42e7-ba50-0a3caae5255d for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:19:27.040404 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:19:27.040640 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] VM Stopped (Lifecycle Event) Jan 26 19:19:27.148815 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Instance destroyed successfully. Jan 26 19:19:27.148815 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lazy-loading 'resources' on Instance uuid 4b54d0fc-613e-4ce1-8ba9-54651f4079bc {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:19:27.447742 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:19:27.520569 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json" returned: 0 in 0.073s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:19:27.521207 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:19:27.544444 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c1348845-15fb-4f73-a703-de4fad90d80a None None] [instance: 0832d494-61af-4cf9-86e6-3a0293b8f09d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:19:27.599107 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:19:27.651845 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:14:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1625004851',display_name='tempest-ServerStableDeviceRescueTest-server-1625004851',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-serverstabledevicerescuetest-server-1625004851',id=93,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:15:18Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='819c3d68b8b1459bbf07574e4b01f715',ramdisk_id='',reservation_id='r-ewf5ju8k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1891281471',owner_user_name='tempest-ServerStableDeviceRescueTest-1891281471-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:15:23Z,user_data=None,user_id='2724dd8bb624423083210013b9f090aa',uuid=4b54d0fc-613e-4ce1-8ba9-54651f4079bc,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "address": "fa:16:3e:ee:b3:6b", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb474507-4f", "ovs_interfaceid": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:19:27.652131 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converting VIF {"id": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "address": "fa:16:3e:ee:b3:6b", "network": {"id": "3b04bbe8-c1f4-44a2-afce-297473ef685f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186711469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "819c3d68b8b1459bbf07574e4b01f715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb474507-4f", "ovs_interfaceid": "eb474507-4ff1-42e7-ba50-0a3caae5255d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:19:27.652760 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:b3:6b,bridge_name='br-int',has_traffic_filtering=True,id=eb474507-4ff1-42e7-ba50-0a3caae5255d,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb474507-4f') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:19:27.653057 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:b3:6b,bridge_name='br-int',has_traffic_filtering=True,id=eb474507-4ff1-42e7-ba50-0a3caae5255d,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb474507-4f') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:19:27.655266 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:27.655686 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb474507-4f, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:19:27.658085 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:27.658541 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:27.659830 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:27.660137 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=895f9969-8a89-4e9f-ace6-f1c353ac9f24) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:19:27.661719 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:27.661782 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:19:27.663850 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:b3:6b,bridge_name='br-int',has_traffic_filtering=True,id=eb474507-4ff1-42e7-ba50-0a3caae5255d,network=Network(3b04bbe8-c1f4-44a2-afce-297473ef685f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb474507-4f') Jan 26 19:19:27.664192 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Deleting instance files /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc_del Jan 26 19:19:27.664622 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Deletion of /opt/stack/data/nova/instances/4b54d0fc-613e-4ce1-8ba9-54651f4079bc_del complete Jan 26 19:19:27.695080 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:19:27.695875 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:19:27.712982 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.017s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:19:27.713499 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=7540MB free_disk=371.8779640197754GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:19:27.713662 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:27.713926 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:28.178138 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Took 1.30 seconds to destroy the instance on the hypervisor. Jan 26 19:19:28.178814 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:19:28.179355 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:19:28.179871 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:19:28.180553 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:19:28.279442 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:19:28.663951 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-83f2ff69-831d-46a3-a087-16ba59ae638a req-91233175-e821-45dd-be13-3ba92b7a7bf0 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received event network-vif-deleted-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:19:28.664517 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-83f2ff69-831d-46a3-a087-16ba59ae638a req-91233175-e821-45dd-be13-3ba92b7a7bf0 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Neutron deleted interface eb474507-4ff1-42e7-ba50-0a3caae5255d; detaching it from the instance and deleting it from the info cache Jan 26 19:19:28.664517 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-83f2ff69-831d-46a3-a087-16ba59ae638a req-91233175-e821-45dd-be13-3ba92b7a7bf0 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:19:28.783701 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 4b54d0fc-613e-4ce1-8ba9-54651f4079bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:19:28.784329 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 1 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:19:28.784670 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=704MB phys_disk=399GB used_disk=1GB total_vcpus=8 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:19:27 up 47 min, 13 users, load average: 3.57, 4.63, 4.35\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_deleting': '1', 'num_os_type_None': '1', 'num_proj_819c3d68b8b1459bbf07574e4b01f715': '1', 'io_workload': '0'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:19:28.884654 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:19:29.079734 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-27e87542-8e7b-4232-acc9-714da95f9ee5 req-e6ae2387-1763-43ad-a997-d6d576bb6798 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received event network-vif-unplugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:19:29.080187 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-27e87542-8e7b-4232-acc9-714da95f9ee5 req-e6ae2387-1763-43ad-a997-d6d576bb6798 service nova] Acquiring lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:29.080609 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-27e87542-8e7b-4232-acc9-714da95f9ee5 req-e6ae2387-1763-43ad-a997-d6d576bb6798 service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:29.081072 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-27e87542-8e7b-4232-acc9-714da95f9ee5 req-e6ae2387-1763-43ad-a997-d6d576bb6798 service nova] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:29.081472 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-27e87542-8e7b-4232-acc9-714da95f9ee5 req-e6ae2387-1763-43ad-a997-d6d576bb6798 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] No waiting events found dispatching network-vif-unplugged-eb474507-4ff1-42e7-ba50-0a3caae5255d {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:19:29.081887 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-27e87542-8e7b-4232-acc9-714da95f9ee5 req-e6ae2387-1763-43ad-a997-d6d576bb6798 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Received event network-vif-unplugged-eb474507-4ff1-42e7-ba50-0a3caae5255d for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:19:29.117160 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:19:29.169936 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-83f2ff69-831d-46a3-a087-16ba59ae638a req-91233175-e821-45dd-be13-3ba92b7a7bf0 service nova] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Detach interface failed, port_id=eb474507-4ff1-42e7-ba50-0a3caae5255d, reason: Instance 4b54d0fc-613e-4ce1-8ba9-54651f4079bc could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:19:29.392734 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:19:29.620827 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Took 1.44 seconds to deallocate network for instance. Jan 26 19:19:29.904545 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:19:29.905508 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.191s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:29.905508 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:19:30.132174 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:30.132580 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:30.170867 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Refreshing inventories for resource provider f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}} Jan 26 19:19:30.209381 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Updating ProviderTree inventory for provider f627156c-932e-4a32-97b3-315a994a2ac9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}} Jan 26 19:19:30.209649 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Updating inventory in ProviderTree for provider f627156c-932e-4a32-97b3-315a994a2ac9 with inventory: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jan 26 19:19:30.243992 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Refreshing aggregate associations for resource provider f627156c-932e-4a32-97b3-315a994a2ac9, aggregates: None {{(pid=189076) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}} Jan 26 19:19:30.291647 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Refreshing trait associations for resource provider f627156c-932e-4a32-97b3-315a994a2ac9, traits: COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_ADDRESS_SPACE_EMULATED,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOUND_MODEL_SB16,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_IGB,HW_ARCH_X86_64,COMPUTE_ARCH_X86_64,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_SECURITY_STATELESS_FIRMWARE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOUND_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOUND_MODEL_AC97,COMPUTE_SOUND_MODEL_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ADDRESS_SPACE_PASSTHROUGH {{(pid=189076) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}} Jan 26 19:19:30.359555 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:19:30.864137 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:19:31.370616 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.238s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:31.435508 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Deleted allocations for instance 4b54d0fc-613e-4ce1-8ba9-54651f4079bc Jan 26 19:19:32.448956 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a4cef323-0fda-4ad7-a518-677c94ce25c3 tempest-ServerStableDeviceRescueTest-1891281471 tempest-ServerStableDeviceRescueTest-1891281471-project-member] Lock "4b54d0fc-613e-4ce1-8ba9-54651f4079bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.082s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:32.661872 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:32.909324 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:19:32.909712 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:19:32.910038 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:19:34.188321 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:34.790603 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:19:34.790603 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] VM Stopped (Lifecycle Event) Jan 26 19:19:35.295391 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-f90caf3c-f8b6-4460-89db-ce6ceef7c7dc None None] [instance: 26e2c1ab-94b1-4731-afc4-9c987e187c8d] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:19:35.893174 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:19:35.894627 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:19:35.894753 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:19:36.958747 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquiring lock "d5092dc4-13a5-45d1-945f-86e9bf4f022f" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:36.959210 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "d5092dc4-13a5-45d1-945f-86e9bf4f022f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:37.282760 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquiring lock "e25d661c-9fcd-4351-9401-412f69232cc2" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:37.283146 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "e25d661c-9fcd-4351-9401-412f69232cc2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:37.462911 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:19:37.665072 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:37.786892 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:19:38.008247 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:38.008868 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:38.012427 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:19:38.012608 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Claim successful on node np0005596550.novalocal Jan 26 19:19:38.337632 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:39.137333 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:19:39.641439 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:19:39.891692 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:19:40.147100 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.138s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:40.149675 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:19:40.154857 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.817s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:40.160290 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:19:40.160603 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Claim successful on node np0005596550.novalocal Jan 26 19:19:40.661160 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Not allocating networking since 'none' was specified. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2039}} Jan 26 19:19:41.164147 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:19:41.293477 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:19:41.670694 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:19:41.799798 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:19:42.147665 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:19:42.147944 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] VM Stopped (Lifecycle Event) Jan 26 19:19:42.309922 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.155s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:42.310644 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:19:42.658504 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-cfc180b5-6814-4309-8abd-4e2cfa876788 None None] [instance: 4b54d0fc-613e-4ce1-8ba9-54651f4079bc] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:19:42.666045 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:19:42.681735 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:19:42.682514 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:19:42.682867 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Creating image(s) Jan 26 19:19:42.683300 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5092dc4-13a5-45d1-945f-86e9bf4f022f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:42.683731 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "/opt/stack/data/nova/instances/d5092dc4-13a5-45d1-945f-86e9bf4f022f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:42.684605 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "/opt/stack/data/nova/instances/d5092dc4-13a5-45d1-945f-86e9bf4f022f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:42.685119 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:19:42.688061 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:19:42.689258 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:19:42.770900 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.081s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:19:42.771372 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:42.772216 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:42.772418 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:19:42.776501 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:19:42.777074 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:19:42.821100 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Not allocating networking since 'none' was specified. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2039}} Jan 26 19:19:42.848530 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.071s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:19:42.848861 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/d5092dc4-13a5-45d1-945f-86e9bf4f022f/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:19:42.875812 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/d5092dc4-13a5-45d1-945f-86e9bf4f022f/disk 1073741824" returned: 0 in 0.026s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:19:42.876231 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.104s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:42.876561 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:19:42.951843 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.074s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:19:42.951843 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5092dc4-13a5-45d1-945f-86e9bf4f022f/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:19:42.951843 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5092dc4-13a5-45d1-945f-86e9bf4f022f/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:19:43.018728 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5092dc4-13a5-45d1-945f-86e9bf4f022f/disk --force-share --output=json" returned: 0 in 0.067s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:19:43.019167 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Cannot resize image /opt/stack/data/nova/instances/d5092dc4-13a5-45d1-945f-86e9bf4f022f/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:19:43.019562 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:19:43.019802 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Ensure instance console log exists: /opt/stack/data/nova/instances/d5092dc4-13a5-45d1-945f-86e9bf4f022f/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:19:43.020147 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:43.020617 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:43.020833 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:43.022348 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Start _get_guest_xml network_info=[] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:19:43.026700 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:19:43.029518 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerShowV247Test-server-889702006', uuid='d5092dc4-13a5-45d1-945f-86e9bf4f022f'), owner=OwnerMeta(userid='f345f5a2f4794d8fbd49411806f106cd', username='tempest-ServerShowV247Test-1143099764-project-member', projectid='09e4a9288bb347f389174e97573200de', projectname='tempest-ServerShowV247Test-1143099764'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[], nova_package='32.1.0', creation_time=1769473183.028692) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:19:43.031468 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:19:43.032254 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:19:43.033938 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:19:43.034870 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:19:43.036573 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:19:43.037273 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:19:43.037673 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:19:43.038026 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:19:43.038455 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:19:43.038705 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:19:43.039072 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:19:43.039453 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:19:43.039731 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:19:43.040091 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:19:43.040428 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:19:43.040928 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:19:43.047175 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lazy-loading 'pci_devices' on Instance uuid d5092dc4-13a5-45d1-945f-86e9bf4f022f {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:19:43.323479 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] End _get_guest_xml xml= Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: d5092dc4-13a5-45d1-945f-86e9bf4f022f Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: instance-00000063 Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: tempest-ServerShowV247Test-server-889702006 Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:19:43 Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: tempest-ServerShowV247Test-1143099764-project-member Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: tempest-ServerShowV247Test-1143099764 Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: d5092dc4-13a5-45d1-945f-86e9bf4f022f Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: d5092dc4-13a5-45d1-945f-86e9bf4f022f Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:43.551587 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:19:43.829026 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:19:44.841408 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:19:44.843584 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:19:44.844235 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Creating image(s) Jan 26 19:19:44.845171 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquiring lock "/opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:44.845527 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "/opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:44.846523 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "/opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:44.847332 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:19:44.853897 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:19:44.855902 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:19:44.895685 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:19:44.896019 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Cleaning up deleted instances with incomplete migration {{(pid=189076) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11998}} Jan 26 19:19:44.921857 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.066s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:19:44.922288 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:44.922821 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:44.923453 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:19:44.927694 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:19:44.928154 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:19:44.993181 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.065s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:19:44.993615 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:19:45.071690 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:19:45.071883 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:19:45.072431 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Using config drive Jan 26 19:19:45.149561 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk 1073741824" returned: 0 in 0.156s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:19:45.149969 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.227s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:45.150322 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:19:45.230052 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.079s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:19:45.230349 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:19:45.230578 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:19:45.296114 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk --force-share --output=json" returned: 0 in 0.065s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:19:45.296710 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Cannot resize image /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:19:45.297391 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:19:45.297752 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Ensure instance console log exists: /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:19:45.298303 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:45.298730 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:45.299103 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:45.301615 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Start _get_guest_xml network_info=[] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:19:45.307546 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:19:45.309662 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-ServerShowV247Test-server-1180511619', uuid='e25d661c-9fcd-4351-9401-412f69232cc2'), owner=OwnerMeta(userid='f345f5a2f4794d8fbd49411806f106cd', username='tempest-ServerShowV247Test-1143099764-project-member', projectid='09e4a9288bb347f389174e97573200de', projectname='tempest-ServerShowV247Test-1143099764'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[], nova_package='32.1.0', creation_time=1769473185.3090158) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:19:45.311455 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:19:45.312083 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:19:45.313844 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:19:45.314275 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:19:45.315829 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:19:45.316464 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:19:45.316938 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:19:45.317226 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:19:45.317611 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:19:45.317904 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:19:45.318157 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:19:45.318545 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:19:45.318851 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:19:45.319145 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:19:45.319446 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:19:45.319841 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:19:45.325975 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lazy-loading 'pci_devices' on Instance uuid e25d661c-9fcd-4351-9401-412f69232cc2 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:19:45.582133 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:19:45.648306 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Creating config drive at /opt/stack/data/nova/instances/d5092dc4-13a5-45d1-945f-86e9bf4f022f/disk.config Jan 26 19:19:45.653927 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/d5092dc4-13a5-45d1-945f-86e9bf4f022f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp2vkm8irh {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:19:45.785201 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/d5092dc4-13a5-45d1-945f-86e9bf4f022f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp2vkm8irh" returned: 0 in 0.131s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] End _get_guest_xml xml= Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: e25d661c-9fcd-4351-9401-412f69232cc2 Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: instance-00000064 Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: tempest-ServerShowV247Test-server-1180511619 Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:19:45 Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: tempest-ServerShowV247Test-1143099764-project-member Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: tempest-ServerShowV247Test-1143099764 Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: e25d661c-9fcd-4351-9401-412f69232cc2 Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: e25d661c-9fcd-4351-9401-412f69232cc2 Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:45.832401 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:19:46.014194 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:19:46.015221 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] VM Resumed (Lifecycle Event) Jan 26 19:19:46.018257 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Instance event wait completed in 0 seconds for {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:19:46.018532 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:19:46.026645 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Instance spawned successfully. Jan 26 19:19:46.027021 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:19:46.519154 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:19:46.521945 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:19:46.535569 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:19:46.535744 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:19:46.536306 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:19:46.537200 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:19:46.537583 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:19:46.537964 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:19:47.025274 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:19:47.025830 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:19:47.025830 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] VM Started (Lifecycle Event) Jan 26 19:19:47.044787 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Took 4.36 seconds to spawn the instance on the hypervisor. Jan 26 19:19:47.045008 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:19:47.507237 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:19:47.507352 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:19:47.507886 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Using config drive Jan 26 19:19:47.528534 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:19:47.533073 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:19:47.559608 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Took 9.59 seconds to build instance. Jan 26 19:19:47.667867 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:19:47.669641 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:19:47.669920 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:19:47.670159 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:19:47.698083 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:47.698083 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:19:48.014064 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:19:48.046543 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Creating config drive at /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk.config Jan 26 19:19:48.049389 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpl24zbr4w {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:19:48.064332 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44dfae6e-98dd-4a27-bb44-a3619fc3f161 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "d5092dc4-13a5-45d1-945f-86e9bf4f022f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 11.104s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:48.172544 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpl24zbr4w" returned: 0 in 0.123s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:19:48.379105 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:19:48.379362 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] VM Resumed (Lifecycle Event) Jan 26 19:19:48.382443 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Instance event wait completed in 0 seconds for {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:19:48.382700 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:19:48.386275 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Instance spawned successfully. Jan 26 19:19:48.386620 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:19:48.885785 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:19:48.894716 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:19:48.899119 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:19:48.899266 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:19:48.899599 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:19:48.902084 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:19:48.903616 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:19:48.904680 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:19:49.413610 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:19:49.414078 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:19:49.414078 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] VM Started (Lifecycle Event) Jan 26 19:19:49.416491 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Took 4.57 seconds to spawn the instance on the hypervisor. Jan 26 19:19:49.416690 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:19:49.917447 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:19:49.921411 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:19:49.928465 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Took 11.63 seconds to build instance. Jan 26 19:19:50.422350 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._sync_power_states {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:19:50.431299 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-9e3c92f8-d31a-4ada-9dba-1c30f2a21a42 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "e25d661c-9fcd-4351-9401-412f69232cc2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 13.148s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:50.932576 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Triggering sync for uuid d5092dc4-13a5-45d1-945f-86e9bf4f022f {{(pid=189076) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11071}} Jan 26 19:19:50.933172 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Triggering sync for uuid e25d661c-9fcd-4351-9401-412f69232cc2 {{(pid=189076) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11071}} Jan 26 19:19:50.933781 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "d5092dc4-13a5-45d1-945f-86e9bf4f022f" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:50.934169 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "d5092dc4-13a5-45d1-945f-86e9bf4f022f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:50.934585 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "e25d661c-9fcd-4351-9401-412f69232cc2" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:50.935133 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "e25d661c-9fcd-4351-9401-412f69232cc2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:50.935274 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] During sync_power_state the instance has a pending task (rebuilding). Skip. Jan 26 19:19:50.935757 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "e25d661c-9fcd-4351-9401-412f69232cc2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:51.444113 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "d5092dc4-13a5-45d1-945f-86e9bf4f022f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.510s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:51.677852 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Rebuilding instance Jan 26 19:19:51.782135 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:19:52.699307 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:19:52.704430 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:19:52.704663 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5006 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:19:52.704916 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:19:52.754689 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:52.755062 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:19:53.041635 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Instance destroyed successfully. Jan 26 19:19:53.049029 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Instance destroyed successfully. Jan 26 19:19:53.049908 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Deleting instance files /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2_del Jan 26 19:19:53.050823 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Deletion of /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2_del complete Jan 26 19:19:54.582792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:19:54.583372 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Creating image(s) Jan 26 19:19:54.583717 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquiring lock "/opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:54.583956 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "/opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:54.584587 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "/opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:54.585141 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:19:54.588899 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:19:54.590355 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:19:54.667105 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json" returned: 0 in 0.076s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:19:54.667496 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquiring lock "791283f4306f6266c365d052f132d740f0c9b85f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:54.667998 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "791283f4306f6266c365d052f132d740f0c9b85f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:54.668480 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:19:54.672220 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:19:54.672570 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:19:54.754429 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json" returned: 0 in 0.081s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:19:54.754869 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f,backing_fmt=raw /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:19:54.790630 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f,backing_fmt=raw /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk 1073741824" returned: 0 in 0.035s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:19:54.791080 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "791283f4306f6266c365d052f132d740f0c9b85f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.123s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:54.791424 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:19:54.868477 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f --force-share --output=json" returned: 0 in 0.076s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:19:54.868830 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:19:54.869104 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:19:54.961761 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:19:54.962124 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Cannot resize image /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:19:54.962529 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:19:54.962710 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Ensure instance console log exists: /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:19:54.963094 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:19:54.963412 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:19:54.963589 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:19:54.965091 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Start _get_guest_xml network_info=[] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-01-26T23:49:28Z,direct_url=,disk_format='qcow2',id=bd70f82e-84e0-4042-ad07-7b834bb8ac38,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-01-26T23:49:31Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:19:54.973885 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError Jan 26 19:19:54.976202 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bd70f82e-84e0-4042-ad07-7b834bb8ac38', instance_meta=NovaInstanceMeta(name='tempest-ServerShowV247Test-server-1180511619', uuid='e25d661c-9fcd-4351-9401-412f69232cc2'), owner=OwnerMeta(userid='f345f5a2f4794d8fbd49411806f106cd', username='tempest-ServerShowV247Test-1143099764-project-member', projectid='09e4a9288bb347f389174e97573200de', projectname='tempest-ServerShowV247Test-1143099764'), image=ImageMeta(id='bd70f82e-84e0-4042-ad07-7b834bb8ac38', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[], nova_package='32.1.0', creation_time=1769473194.9758482) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:19:54.980048 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:19:54.980388 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:19:54.981610 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:19:54.982028 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:19:54.983177 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:19:54.983824 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-01-26T23:49:28Z,direct_url=,disk_format='qcow2',id=bd70f82e-84e0-4042-ad07-7b834bb8ac38,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-01-26T23:49:31Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:19:54.983956 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:19:54.984096 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:19:54.984439 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:19:54.984697 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:19:54.984852 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:19:54.985116 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:19:54.985509 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:19:54.985509 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:19:54.985822 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:19:54.985852 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:19:54.986043 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lazy-loading 'vcpu_model' on Instance uuid e25d661c-9fcd-4351-9401-412f69232cc2 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] End _get_guest_xml xml= Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: e25d661c-9fcd-4351-9401-412f69232cc2 Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: instance-00000064 Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: tempest-ServerShowV247Test-server-1180511619 Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:19:54 Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: tempest-ServerShowV247Test-1143099764-project-member Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: tempest-ServerShowV247Test-1143099764 Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: e25d661c-9fcd-4351-9401-412f69232cc2 Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: e25d661c-9fcd-4351-9401-412f69232cc2 Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: Jan 26 19:19:55.494447 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:19:57.020243 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:19:57.021427 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:19:57.021427 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Using config drive Jan 26 19:19:57.527518 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lazy-loading 'ec2_ids' on Instance uuid e25d661c-9fcd-4351-9401-412f69232cc2 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:19:57.794571 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:19:57.794571 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:19:57.794571 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:19:57.794571 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:19:57.796391 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:19:57.797189 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:19:58.033604 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Object Instance lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:19:58.034369 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lazy-loading 'keypairs' on Instance uuid e25d661c-9fcd-4351-9401-412f69232cc2 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:19:58.537940 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Object Instance lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:19:58.540234 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError Jan 26 19:19:58.575857 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Creating config drive at /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk.config Jan 26 19:19:58.578640 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpmyhfimng {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:19:58.700753 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpmyhfimng" returned: 0 in 0.122s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:19:58.959707 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for e25d661c-9fcd-4351-9401-412f69232cc2 due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:19:58.959948 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:19:58.960152 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] VM Resumed (Lifecycle Event) Jan 26 19:19:58.962168 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Instance event wait completed in 0 seconds for {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:19:58.962406 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:19:58.971670 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Instance spawned successfully. Jan 26 19:19:58.972020 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:19:59.465008 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:19:59.469026 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:19:59.490170 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:19:59.490170 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:19:59.490170 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:19:59.490170 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:19:59.490399 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:19:59.490608 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:19:59.976952 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] During sync_power_state the instance has a pending task (rebuild_spawning). Skip. Jan 26 19:19:59.977232 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:19:59.977405 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] VM Started (Lifecycle Event) Jan 26 19:19:59.998085 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:20:00.525317 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:20:00.525317 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:20:00.525317 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:20:00.525317 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:20:00.525317 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Trying to apply a migration context that does not seem to be set for this instance {{(pid=189076) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}} Jan 26 19:20:01.372499 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquiring lock "e25d661c-9fcd-4351-9401-412f69232cc2" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:20:01.372737 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "e25d661c-9fcd-4351-9401-412f69232cc2" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:20:01.372979 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquiring lock "e25d661c-9fcd-4351-9401-412f69232cc2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:20:01.373167 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "e25d661c-9fcd-4351-9401-412f69232cc2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:20:01.373433 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "e25d661c-9fcd-4351-9401-412f69232cc2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:20:01.375730 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Terminating instance Jan 26 19:20:01.522789 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8633cb95-da84-4655-bcc2-01a3eb84ffc9 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.011s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:20:01.879721 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquiring lock "refresh_cache-e25d661c-9fcd-4351-9401-412f69232cc2" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:20:01.880499 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquired lock "refresh_cache-e25d661c-9fcd-4351-9401-412f69232cc2" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:20:01.880499 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:20:02.384005 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:20:02.423884 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:20:02.652202 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:20:02.797702 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:20:02.798577 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:20:02.828649 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:20:02.828649 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:20:02.833921 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:02.834226 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:20:03.155310 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Releasing lock "refresh_cache-e25d661c-9fcd-4351-9401-412f69232cc2" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:20:03.156037 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:20:03.412546 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Instance destroyed successfully. Jan 26 19:20:03.413025 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lazy-loading 'resources' on Instance uuid e25d661c-9fcd-4351-9401-412f69232cc2 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:20:03.916540 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Deleting instance files /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2_del Jan 26 19:20:03.917496 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Deletion of /opt/stack/data/nova/instances/e25d661c-9fcd-4351-9401-412f69232cc2_del complete Jan 26 19:20:04.427388 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Took 1.27 seconds to destroy the instance on the hypervisor. Jan 26 19:20:04.427958 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:20:04.428156 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:20:04.428334 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:20:04.428657 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:20:04.479418 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:20:04.479761 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:20:04.982973 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:20:05.485792 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Took 1.06 seconds to deallocate network for instance. Jan 26 19:20:05.991708 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:20:05.991927 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:20:06.093800 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:20:06.597677 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:20:07.103953 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.112s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:20:07.263089 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Deleted allocations for instance e25d661c-9fcd-4351-9401-412f69232cc2 Jan 26 19:20:07.835816 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:20:07.837350 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:20:07.837599 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:20:07.837823 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:20:07.874871 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:07.875267 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:20:08.273298 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-531ec4dd-add0-4b79-847b-0b4f798b9db8 tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "e25d661c-9fcd-4351-9401-412f69232cc2" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.900s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:20:09.237430 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquiring lock "d5092dc4-13a5-45d1-945f-86e9bf4f022f" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:20:09.238167 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "d5092dc4-13a5-45d1-945f-86e9bf4f022f" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:20:09.238167 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquiring lock "d5092dc4-13a5-45d1-945f-86e9bf4f022f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:20:09.238167 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "d5092dc4-13a5-45d1-945f-86e9bf4f022f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:20:09.238167 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "d5092dc4-13a5-45d1-945f-86e9bf4f022f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:20:09.241283 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Terminating instance Jan 26 19:20:09.749431 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquiring lock "refresh_cache-d5092dc4-13a5-45d1-945f-86e9bf4f022f" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:20:09.749607 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquired lock "refresh_cache-d5092dc4-13a5-45d1-945f-86e9bf4f022f" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:20:09.749643 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:20:10.253088 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:20:10.311075 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:20:10.463574 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:20:10.966579 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Releasing lock "refresh_cache-d5092dc4-13a5-45d1-945f-86e9bf4f022f" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:20:10.966912 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:20:11.207759 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Instance destroyed successfully. Jan 26 19:20:11.208238 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lazy-loading 'resources' on Instance uuid d5092dc4-13a5-45d1-945f-86e9bf4f022f {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:20:11.711174 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Deleting instance files /opt/stack/data/nova/instances/d5092dc4-13a5-45d1-945f-86e9bf4f022f_del Jan 26 19:20:11.711983 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Deletion of /opt/stack/data/nova/instances/d5092dc4-13a5-45d1-945f-86e9bf4f022f_del complete Jan 26 19:20:12.223596 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Took 1.26 seconds to destroy the instance on the hypervisor. Jan 26 19:20:12.224142 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:20:12.224561 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:20:12.224912 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:20:12.225303 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:20:12.267301 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:20:12.267534 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:20:12.771089 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:20:12.876601 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:20:12.878063 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:20:12.878171 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:20:12.878334 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:20:12.927850 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:12.927850 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:20:13.274223 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Took 1.05 seconds to deallocate network for instance. Jan 26 19:20:13.782906 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:20:13.783296 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:20:13.876018 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:20:14.378818 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:20:14.884378 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.101s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:20:14.935835 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Deleted allocations for instance d5092dc4-13a5-45d1-945f-86e9bf4f022f Jan 26 19:20:15.969931 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-505911e7-a4d3-4bf3-a697-5ae0669ef09e tempest-ServerShowV247Test-1143099764 tempest-ServerShowV247Test-1143099764-project-member] Lock "d5092dc4-13a5-45d1-945f-86e9bf4f022f" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.731s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:20:17.446413 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:17.929237 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:18.412578 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:20:18.412759 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] VM Stopped (Lifecycle Event) Jan 26 19:20:18.920720 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a28ab288-f1fe-4b39-b191-aeaf2481387c None None] [instance: e25d661c-9fcd-4351-9401-412f69232cc2] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:20:22.940495 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:20:22.940495 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:20:22.940495 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:20:22.940495 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:20:22.942696 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:22.943086 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:20:23.959801 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:25.409441 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:20:25.896122 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:20:26.206572 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:20:26.206677 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] VM Stopped (Lifecycle Event) Jan 26 19:20:26.250012 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:26.400868 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:20:26.401130 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:20:26.401306 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:20:26.401481 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:20:26.478062 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:20:26.479016 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:20:26.503138 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.024s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:20:26.503584 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=8125MB free_disk=371.8876304626465GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:20:26.503584 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:20:26.503839 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:20:26.709709 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-8b6b09b7-2b7c-48ce-8ba4-40d79a669704 None None] [instance: d5092dc4-13a5-45d1-945f-86e9bf4f022f] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:20:27.546197 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 0 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:20:27.546670 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=512MB phys_disk=399GB used_disk=0GB total_vcpus=8 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:20:26 up 48 min, 13 users, load average: 2.51, 4.12, 4.19\n'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:20:27.579396 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:20:27.981112 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:28.085641 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:20:28.349539 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:28.594070 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:20:28.594553 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.090s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:20:29.594653 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:20:30.895628 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:20:31.895884 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:20:32.760590 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "a7010931-641e-45d6-a8df-edd43c91ae9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:20:32.760861 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "a7010931-641e-45d6-a8df-edd43c91ae9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:20:32.895251 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:20:32.984483 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:33.264542 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:20:33.352107 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:33.813124 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:20:33.813384 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:20:33.817655 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:20:33.817818 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Claim successful on node np0005596550.novalocal Jan 26 19:20:34.920322 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:20:35.424500 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:20:35.931393 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.118s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:20:35.931853 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:20:36.440755 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:20:36.441052 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:20:36.441566 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:20:36.441984 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:20:36.521059 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2494a2c41134b13a25b86d1bdfdd65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a07dd99b19249acb501695a25608424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:20:36.892330 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:20:36.945726 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:20:37.308441 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Successfully created port: 5fdbea35-aadf-4a3d-8726-9c25e56a741d {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:20:37.450803 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:20:37.752501 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Successfully updated port: 5fdbea35-aadf-4a3d-8726-9c25e56a741d {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:20:37.822319 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d4818d5e-61aa-4cdf-a838-47f1ecddaf49 req-0f4d2a7b-b859-4ec4-b28b-babd4667ee0b service nova] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Received event network-changed-5fdbea35-aadf-4a3d-8726-9c25e56a741d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:20:37.822503 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d4818d5e-61aa-4cdf-a838-47f1ecddaf49 req-0f4d2a7b-b859-4ec4-b28b-babd4667ee0b service nova] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Refreshing instance network info cache due to event network-changed-5fdbea35-aadf-4a3d-8726-9c25e56a741d. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:20:37.822699 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d4818d5e-61aa-4cdf-a838-47f1ecddaf49 req-0f4d2a7b-b859-4ec4-b28b-babd4667ee0b service nova] Acquiring lock "refresh_cache-a7010931-641e-45d6-a8df-edd43c91ae9b" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:20:37.822883 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d4818d5e-61aa-4cdf-a838-47f1ecddaf49 req-0f4d2a7b-b859-4ec4-b28b-babd4667ee0b service nova] Acquired lock "refresh_cache-a7010931-641e-45d6-a8df-edd43c91ae9b" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:20:37.823078 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-d4818d5e-61aa-4cdf-a838-47f1ecddaf49 req-0f4d2a7b-b859-4ec4-b28b-babd4667ee0b service nova] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Refreshing network info cache for port 5fdbea35-aadf-4a3d-8726-9c25e56a741d {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:20:37.895381 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:20:37.895567 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:20:37.955453 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.block_device [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Booting with volume ca64cda4-10f8-4f8f-b040-884ced50b4d2 at /dev/vda Jan 26 19:20:38.003544 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': True, 'host': 'np0005596550.novalocal', 'execute': None}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:20:38.004670 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:20:38.014550 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:20:38.014718 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0eba0dc-34c1-4146-a183-8154709941fd]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:20:38.017814 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[f56a444d-5162-4342-9aff-6fc5ab6309dd]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:20:38.017814 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:20:38.017814 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:20:38.017814 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:20:38.017814 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:20:38.017814 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:20:38.017814 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:20:38.017814 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:20:38.017814 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:20:38.017814 np0005596550.novalocal nova-compute[189076]: with open_scini_device() as fd: Jan 26 19:20:38.017814 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:20:38.017814 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:20:38.017814 np0005596550.novalocal nova-compute[189076]: return next(self.gen) Jan 26 19:20:38.017814 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^ Jan 26 19:20:38.017814 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:20:38.017814 np0005596550.novalocal nova-compute[189076]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:20:38.017814 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:20:38.017814 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:20:38.018788 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56a444d-5162-4342-9aff-6fc5ab6309dd]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:20:38.019198 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.scaleio [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:20:38.019396 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.scaleio [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:20:38.020113 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:20:38.028498 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:20:38.028662 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74da262-1eff-429d-8774-6071d7e5305a]: (4, ('/dev/vda2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:20:38.029893 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:20:38.040134 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:20:38.040367 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8feb38-5435-432c-919c-4f3a09c12dd6]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:20:38.041413 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3207c9d-64b1-4b25-a694-dcbcf325787a]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:20:38.042006 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): nvme version {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:20:38.056606 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:38.060145 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] 'nvme version' failed. Not Retrying. {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:20:38.060388 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] nvme not present on system {{(pid=189076) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:20:38.061826 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=189076) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:20:38.062298 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.lightos [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48'] Jan 26 19:20:38.062465 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:20:38.062633 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:20:38.062913 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] <== get_connector_properties: return (59ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': True, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48']} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:20:38.063105 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.block_device [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Updating existing volume attachment record: bf9cde10-7fe0-4e70-b403-19b428a1b8a1 {{(pid=189076) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jan 26 19:20:38.259128 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "refresh_cache-a7010931-641e-45d6-a8df-edd43c91ae9b" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:20:38.327309 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-d4818d5e-61aa-4cdf-a838-47f1ecddaf49 req-0f4d2a7b-b859-4ec4-b28b-babd4667ee0b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:20:38.391113 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-d4818d5e-61aa-4cdf-a838-47f1ecddaf49 req-0f4d2a7b-b859-4ec4-b28b-babd4667ee0b service nova] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:20:38.506580 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-d4818d5e-61aa-4cdf-a838-47f1ecddaf49 req-0f4d2a7b-b859-4ec4-b28b-babd4667ee0b service nova] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:20:39.009675 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d4818d5e-61aa-4cdf-a838-47f1ecddaf49 req-0f4d2a7b-b859-4ec4-b28b-babd4667ee0b service nova] Releasing lock "refresh_cache-a7010931-641e-45d6-a8df-edd43c91ae9b" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:20:39.010276 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquired lock "refresh_cache-a7010931-641e-45d6-a8df-edd43c91ae9b" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:20:39.010426 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:20:39.573805 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:20:39.702796 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:20:39.794994 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Updating instance_info_cache with network_info: [{"id": "5fdbea35-aadf-4a3d-8726-9c25e56a741d", "address": "fa:16:3e:c2:72:0d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdbea35-aa", "ovs_interfaceid": "5fdbea35-aadf-4a3d-8726-9c25e56a741d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:20:40.298534 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Releasing lock "refresh_cache-a7010931-641e-45d6-a8df-edd43c91ae9b" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:20:40.299076 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Instance network_info: |[{"id": "5fdbea35-aadf-4a3d-8726-9c25e56a741d", "address": "fa:16:3e:c2:72:0d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdbea35-aa", "ovs_interfaceid": "5fdbea35-aadf-4a3d-8726-9c25e56a741d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:20:43.058022 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:20:43.105855 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:20:43.105855 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:20:43.105855 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:20:43.106032 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:43.106292 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:20:43.352408 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:43.691451 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:20:43.692336 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:20:43.692607 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Creating image(s) Jan 26 19:20:43.692885 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Did not create local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5295}} Jan 26 19:20:43.693037 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Ensure instance console log exists: /opt/stack/data/nova/instances/a7010931-641e-45d6-a8df-edd43c91ae9b/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:20:43.693249 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:20:43.693458 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:20:43.693637 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:20:43.695757 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Start _get_guest_xml network_info=[{"id": "5fdbea35-aadf-4a3d-8726-9c25e56a741d", "address": "fa:16:3e:c2:72:0d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdbea35-aa", "ovs_interfaceid": "5fdbea35-aadf-4a3d-8726-9c25e56a741d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'bf9cde10-7fe0-4e70-b403-19b428a1b8a1', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2', 'target_lun': 0, 'volume_id': 'ca64cda4-10f8-4f8f-b040-884ced50b4d2', 'auth_method': 'CHAP', 'auth_username': '7S6USSANTqt6CsGomydX', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a7010931-641e-45d6-a8df-edd43c91ae9b', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca64cda4-10f8-4f8f-b040-884ced50b4d2', 'serial': 'ca64cda4-10f8-4f8f-b040-884ced50b4d2', 'multiattach': True}, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:20:43.699786 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:20:43.700726 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-1766441062', uuid='a7010931-641e-45d6-a8df-edd43c91ae9b'), owner=OwnerMeta(userid='d2494a2c41134b13a25b86d1bdfdd65f', username='tempest-AttachVolumeMultiAttachTest-1495503700-project-member', projectid='4a07dd99b19249acb501695a25608424', projectname='tempest-AttachVolumeMultiAttachTest-1495503700'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5fdbea35-aadf-4a3d-8726-9c25e56a741d", "address": "fa:16:3e:c2:72:0d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdbea35-aa", "ovs_interfaceid": "5fdbea35-aadf-4a3d-8726-9c25e56a741d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769473243.7004206) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:20:43.702513 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:20:43.702931 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:20:43.704316 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:20:43.704976 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:20:43.705965 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:20:43.706319 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:20:43.706541 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:20:43.706730 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:20:43.706954 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:20:43.707124 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:20:43.707300 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:20:43.707532 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:20:43.707775 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:20:43.707968 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:20:43.708152 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:20:43.708346 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:20:43.711219 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Calling os-brick to attach iSCSI Volume {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jan 26 19:20:43.711972 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2', 'target_lun': 0, 'volume_id': 'ca64cda4-10f8-4f8f-b040-884ced50b4d2', 'auth_method': 'CHAP', 'auth_username': '7S6USSANTqt6CsGomydX', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:20:43.712170 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:20:43.712581 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:20:43.712774 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2', 'target_lun': 0, 'volume_id': 'ca64cda4-10f8-4f8f-b040-884ced50b4d2', 'auth_method': 'CHAP', 'auth_username': '7S6USSANTqt6CsGomydX', 'auth_password': 'Es93cKynGjgNkicB', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True} {{(pid=189076) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:20:43.713832 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:20:43.720094 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:20:43.722529 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[62b3f9f8-dd4f-4e55-b404-f7b3dff34d25]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:20:43.722529 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:20:43.722529 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:20:43.722529 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:20:43.722529 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:20:43.722529 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:20:43.722529 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:20:43.722529 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:20:43.722529 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:20:43.722529 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:20:43.722529 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:20:43.722529 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:20:43.722529 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:20:43.722529 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:20:43.722529 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:20:43.722529 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:20:43.722529 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:20:43.722529 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:20:43.722529 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:20:43.722529 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:20:43.722529 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:20:43.722529 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:20:43.724389 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b3f9f8-dd4f-4e55-b404-f7b3dff34d25]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:20:43.725040 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:20:43.725519 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:20:43.725808 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:20:43.726700 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:20:43.736688 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260" returned: 21 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:20:43.736857 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f75dc2c-020e-4d2a-b86a-ab1d7254ba04]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:20:43.737234 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:20:43.737234 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:20:43.738473 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260 --interface default --op new {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:20:43.749831 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:20:43.749966 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad843ae4-4d6b-4e46-80c3-63eb9d2cc6bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:20:43.750287 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2] added Jan 26 19:20:43.750287 np0005596550.novalocal nova-compute[189076]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:20:43.750287 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:20:43.750287 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:20:43.750287 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:20:43.750445 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=189076) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:20:43.750669 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.025(s), this was the 1st time calling it. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:20:43.750858 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:20:44.751963 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:20:44.753031 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:20:44.760603 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:20:44.760999 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a633411e-1502-476e-9790-aeb5bda9cd8d]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.name = iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.tpgt = -1 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.startup = automatic Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.leading_login = No Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.iscsi_ifacename = default Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.net_ifacename = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.ipaddress = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.prefix_len = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.hwaddress = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.transport_name = tcp Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.initiatorname = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.state = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.vlan_id = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.vlan_priority = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.vlan_state = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.iface_num = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.mtu = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.port = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.bootproto = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.subnet_mask = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.gateway = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id_state = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.dhcp_dns = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.dhcp_learn_iqn = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.dhcp_req_vendor_id_state = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id_state = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.dhcp_slp_da = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.fragmentation = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.gratuitous_arp = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.incoming_forwarding = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.tos_state = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.tos = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.ttl = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.delayed_ack = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.tcp_nagle = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf_state = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.tcp_timer_scale = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.tcp_timestamp = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.redirect = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.def_task_mgmt_timeout = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.header_digest = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.data_digest = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.immediate_data = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.initial_r2t = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.data_seq_inorder = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.data_pdu_inorder = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.erl = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.max_receive_data_len = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.first_burst_len = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.max_outstanding_r2t = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.max_burst_len = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.chap_auth = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.bidi_chap = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.strict_login_compliance = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.discovery_auth = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: iface.discovery_logout = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.discovery_address = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.discovery_port = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.discovery_type = fw Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.initial_cmdsn = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.initial_login_retry_max = 8 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.xmit_thread_priority = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.cmds_max = 128 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.queue_depth = 32 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.nr_sessions = 1 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.auth.authmethod = None Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.auth.username = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.auth.password = *** Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.auth.username_in = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.auth.password_in = Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.timeo.replacement_timeout = 120 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FastAbort = Yes Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.InitialR2T = No Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ImmediateData = Yes Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxConnections = 1 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ERL = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.scan = auto Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.reopen_max = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.session.conn_reopen_log_freq = 1 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.conn[0].address = 38.102.83.18 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.conn[0].port = 3260 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.conn[0].startup = manual Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.window_size = 524288 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.DataDigest = None Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.IFMarker = No Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.OFMarker = No Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: # END RECORD Jan 26 19:20:44.762949 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:20:44.765018 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:20:44.780819 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:20:44.780968 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffaebc03-ec42-4262-9dc5-a114d97a892e]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:20:44.781249 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:20:44.782195 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:20:44.795224 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:20:44.795410 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d445802-3dda-4c5e-a2e5-52411df1ddb8]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:20:44.795676 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:20:44.796503 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v 7S6USSANTqt6CsGomydX {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:20:44.810035 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v 7S6USSANTqt6CsGomydX" returned: 0 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:20:44.810159 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[17792edb-cbc0-4b54-b67f-59e99740da07]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:20:44.810464 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', '7S6USSANTqt6CsGomydX'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:20:44.811549 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:20:44.827473 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.014s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:20:44.827473 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[15523ab0-a87f-453a-929d-4c384fb9973a]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:20:44.827473 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:20:44.828253 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:20:44.843458 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.014s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:20:44.843458 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de049a5-a1bc-4722-b6a4-c5d681cb38a6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:20:44.843458 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jan 26 19:20:44.843458 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:20:44.843458 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jan 26 19:20:44.843458 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:20:44.843458 np0005596550.novalocal nova-compute[189076]: WARNING os_brick.initiator.connectors.iscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jan 26 19:20:44.843458 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:44.844156 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260 --login {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:20:44.863661 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260 --login" returned: 0 in 0.018s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:20:44.863661 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[12be31db-605b-4347-b0eb-0588f7a57908]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:20:44.863661 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2, portal: 38.102.83.18,3260] successful. Jan 26 19:20:44.863661 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:20:44.865434 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:20:44.876638 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:20:44.876638 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d1b3d1-4420-4e0a-8347-8e405d67a15f]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:20:44.876638 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:20:44.877282 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:20:44.886679 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:20:44.886946 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ac706a-99c4-4bca-9389-074dbf926def]: (4, ('tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:20:44.887330 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:20:44.887330 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:20:44.887662 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsi session list stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:20:44.887662 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:20:44.888138 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:20:44.888535 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connected to 38.102.83.18:3260 {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:20:44.889132 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] HCTL ('2', '-', '-', 0) found on session 28 with lun 0 {{(pid=189076) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:20:44.889393 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Scanning host 2 c: -, t: -, l: 0) {{(pid=189076) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:20:44.890267 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host2/scan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:20:44.907079 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host2/scan" returned: 0 in 0.016s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:20:44.907228 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14a1e32-4021-4c37-9377-59b30bd3d5b0]: (4, ('- - 0', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:20:44.907811 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching for a device in session 28 and hctl ['2', '*', '*', 0] yield: None {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:20:45.909374 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching for a device in session 28 and hctl ['2', '*', '*', 0] yield: sda {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:20:45.909891 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connected to sda using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2', 'target_lun': 0, 'volume_id': 'ca64cda4-10f8-4f8f-b040-884ced50b4d2', 'auth_method': 'CHAP', 'auth_username': '7S6USSANTqt6CsGomydX', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True} {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:20:45.910566 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.198s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:20:45.910724 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] <== connect_volume: return (2199ms) {'type': 'block', 'scsi_wwn': '36001405f03c37ba35994c30a4547b83b', 'path': '/dev/sda'} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:20:45.910918 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '36001405f03c37ba35994c30a4547b83b', 'path': '/dev/sda'} {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jan 26 19:20:46.418412 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:20:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1766441062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-attachvolumemultiattachtest-server-1766441062',id=101,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-ohq0mg9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:20:37Z,user_data=None,user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=a7010931-641e-45d6-a8df-edd43c91ae9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fdbea35-aadf-4a3d-8726-9c25e56a741d", "address": "fa:16:3e:c2:72:0d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdbea35-aa", "ovs_interfaceid": "5fdbea35-aadf-4a3d-8726-9c25e56a741d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:20:46.418984 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "5fdbea35-aadf-4a3d-8726-9c25e56a741d", "address": "fa:16:3e:c2:72:0d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdbea35-aa", "ovs_interfaceid": "5fdbea35-aadf-4a3d-8726-9c25e56a741d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:20:46.419124 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:72:0d,bridge_name='br-int',has_traffic_filtering=True,id=5fdbea35-aadf-4a3d-8726-9c25e56a741d,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdbea35-aa') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:20:46.419673 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'pci_devices' on Instance uuid a7010931-641e-45d6-a8df-edd43c91ae9b {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] End _get_guest_xml xml= Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: a7010931-641e-45d6-a8df-edd43c91ae9b Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: instance-00000065 Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: tempest-AttachVolumeMultiAttachTest-server-1766441062 Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:20:43 Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: tempest-AttachVolumeMultiAttachTest-1495503700-project-member Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: tempest-AttachVolumeMultiAttachTest-1495503700 Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: a7010931-641e-45d6-a8df-edd43c91ae9b Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: a7010931-641e-45d6-a8df-edd43c91ae9b Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: ca64cda4-10f8-4f8f-b040-884ced50b4d2 Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: Jan 26 19:20:46.923996 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:20:46.927385 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Preparing to wait for external event network-vif-plugged-5fdbea35-aadf-4a3d-8726-9c25e56a741d {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:20:46.927385 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "a7010931-641e-45d6-a8df-edd43c91ae9b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:20:46.927385 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "a7010931-641e-45d6-a8df-edd43c91ae9b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:20:46.927385 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "a7010931-641e-45d6-a8df-edd43c91ae9b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:20:46.927385 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:20:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1766441062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-attachvolumemultiattachtest-server-1766441062',id=101,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-ohq0mg9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:20:37Z,user_data=None,user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=a7010931-641e-45d6-a8df-edd43c91ae9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fdbea35-aadf-4a3d-8726-9c25e56a741d", "address": "fa:16:3e:c2:72:0d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdbea35-aa", "ovs_interfaceid": "5fdbea35-aadf-4a3d-8726-9c25e56a741d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:20:46.927697 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "5fdbea35-aadf-4a3d-8726-9c25e56a741d", "address": "fa:16:3e:c2:72:0d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdbea35-aa", "ovs_interfaceid": "5fdbea35-aadf-4a3d-8726-9c25e56a741d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:20:46.929400 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:72:0d,bridge_name='br-int',has_traffic_filtering=True,id=5fdbea35-aadf-4a3d-8726-9c25e56a741d,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdbea35-aa') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:20:46.929400 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:72:0d,bridge_name='br-int',has_traffic_filtering=True,id=5fdbea35-aadf-4a3d-8726-9c25e56a741d,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdbea35-aa') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:20:46.929400 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:46.929659 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:20:46.929940 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:20:46.930834 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:46.931222 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '590f9681-f1c4-5e1f-bac8-b6bc7ec84d73', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:20:46.986634 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:46.989046 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:20:46.990262 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:46.995107 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:46.995617 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fdbea35-aa, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:20:46.996240 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5fdbea35-aa, col_values=(('qos', UUID('89b26d62-e9c1-4061-a2b0-b152450b998f')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:20:46.996574 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5fdbea35-aa, col_values=(('external_ids', {'iface-id': '5fdbea35-aadf-4a3d-8726-9c25e56a741d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:72:0d', 'vm-uuid': 'a7010931-641e-45d6-a8df-edd43c91ae9b'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:20:46.999876 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:47.004604 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:20:47.012203 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:47.013579 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:72:0d,bridge_name='br-int',has_traffic_filtering=True,id=5fdbea35-aadf-4a3d-8726-9c25e56a741d,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdbea35-aa') Jan 26 19:20:48.543255 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:20:48.543918 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:20:48.544365 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No VIF found with MAC fa:16:3e:c2:72:0d, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:20:48.545330 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Using config drive Jan 26 19:20:49.052573 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:20:49.168442 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Creating config drive at /opt/stack/data/nova/instances/a7010931-641e-45d6-a8df-edd43c91ae9b/disk.config Jan 26 19:20:49.172597 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/a7010931-641e-45d6-a8df-edd43c91ae9b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpuwdrih9a {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:20:49.303709 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/a7010931-641e-45d6-a8df-edd43c91ae9b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpuwdrih9a" returned: 0 in 0.131s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:20:49.393916 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:49.399260 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:49.576795 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-20362b61-3ddc-46ad-9eb4-a10ed79f9c04 req-0adbbdf9-a2f2-4a4d-88f4-c24d74d57ba0 service nova] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Received event network-vif-plugged-5fdbea35-aadf-4a3d-8726-9c25e56a741d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:20:49.576795 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-20362b61-3ddc-46ad-9eb4-a10ed79f9c04 req-0adbbdf9-a2f2-4a4d-88f4-c24d74d57ba0 service nova] Acquiring lock "a7010931-641e-45d6-a8df-edd43c91ae9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:20:49.578073 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-20362b61-3ddc-46ad-9eb4-a10ed79f9c04 req-0adbbdf9-a2f2-4a4d-88f4-c24d74d57ba0 service nova] Lock "a7010931-641e-45d6-a8df-edd43c91ae9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:20:49.578073 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-20362b61-3ddc-46ad-9eb4-a10ed79f9c04 req-0adbbdf9-a2f2-4a4d-88f4-c24d74d57ba0 service nova] Lock "a7010931-641e-45d6-a8df-edd43c91ae9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:20:49.578073 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-20362b61-3ddc-46ad-9eb4-a10ed79f9c04 req-0adbbdf9-a2f2-4a4d-88f4-c24d74d57ba0 service nova] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Processing event network-vif-plugged-5fdbea35-aadf-4a3d-8726-9c25e56a741d {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:20:49.601798 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:20:49.601798 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] VM Started (Lifecycle Event) Jan 26 19:20:49.604632 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:20:49.613010 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:20:49.613010 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Instance spawned successfully. Jan 26 19:20:49.613010 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:20:49.690094 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:49.691550 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:49.693658 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:49.700153 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:50.105408 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:20:50.108751 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:20:50.123337 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:20:50.123503 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:20:50.124312 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:20:50.124616 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:20:50.125042 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:20:50.125359 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:20:50.612831 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:20:50.614019 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:20:50.615057 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] VM Paused (Lifecycle Event) Jan 26 19:20:50.633597 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Took 6.94 seconds to spawn the instance on the hypervisor. Jan 26 19:20:50.633811 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:20:51.121901 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:20:51.126370 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:20:51.126509 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] VM Resumed (Lifecycle Event) Jan 26 19:20:51.150637 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Took 17.38 seconds to build instance. Jan 26 19:20:51.608376 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-32966419-74ae-44a2-ab68-b97f4eeb2d8a req-650c9f85-bf07-4f56-aaeb-4fe87b8417be service nova] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Received event network-vif-plugged-5fdbea35-aadf-4a3d-8726-9c25e56a741d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:20:51.608591 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-32966419-74ae-44a2-ab68-b97f4eeb2d8a req-650c9f85-bf07-4f56-aaeb-4fe87b8417be service nova] Acquiring lock "a7010931-641e-45d6-a8df-edd43c91ae9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:20:51.608817 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-32966419-74ae-44a2-ab68-b97f4eeb2d8a req-650c9f85-bf07-4f56-aaeb-4fe87b8417be service nova] Lock "a7010931-641e-45d6-a8df-edd43c91ae9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:20:51.608997 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-32966419-74ae-44a2-ab68-b97f4eeb2d8a req-650c9f85-bf07-4f56-aaeb-4fe87b8417be service nova] Lock "a7010931-641e-45d6-a8df-edd43c91ae9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:20:51.609178 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-32966419-74ae-44a2-ab68-b97f4eeb2d8a req-650c9f85-bf07-4f56-aaeb-4fe87b8417be service nova] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] No waiting events found dispatching network-vif-plugged-5fdbea35-aadf-4a3d-8726-9c25e56a741d {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:20:51.609371 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-32966419-74ae-44a2-ab68-b97f4eeb2d8a req-650c9f85-bf07-4f56-aaeb-4fe87b8417be service nova] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Received unexpected event network-vif-plugged-5fdbea35-aadf-4a3d-8726-9c25e56a741d for instance with vm_state active and task_state None. Jan 26 19:20:51.629352 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:20:51.631691 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:20:51.653002 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-51246fd3-4bf5-4da7-b82e-87020489b16f tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "a7010931-641e-45d6-a8df-edd43c91ae9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 18.892s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:20:52.053481 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:53.356384 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:55.052845 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:20:55.053361 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:20:55.555557 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:20:56.114287 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:20:56.114882 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:20:56.120308 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:20:56.120625 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Claim successful on node np0005596550.novalocal Jan 26 19:20:57.057246 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:57.248658 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:20:57.754066 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:20:58.259119 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.144s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:20:58.259671 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:20:58.357590 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:20:58.768228 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:20:58.768536 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:20:58.770846 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:20:58.773527 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:20:58.867156 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2494a2c41134b13a25b86d1bdfdd65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a07dd99b19249acb501695a25608424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:20:59.284668 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:20:59.338891 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Successfully created port: 3efc9a66-48a5-440c-b39f-8e74d8f7fc87 {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:20:59.763614 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Successfully updated port: 3efc9a66-48a5-440c-b39f-8e74d8f7fc87 {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:20:59.788430 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:20:59.810467 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-103f4139-e85f-4d4e-a1ef-ae6e686f5410 req-249c76dd-5186-4411-8b6c-f404c8a43100 service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Received event network-changed-3efc9a66-48a5-440c-b39f-8e74d8f7fc87 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:20:59.810804 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-103f4139-e85f-4d4e-a1ef-ae6e686f5410 req-249c76dd-5186-4411-8b6c-f404c8a43100 service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Refreshing instance network info cache due to event network-changed-3efc9a66-48a5-440c-b39f-8e74d8f7fc87. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:20:59.811141 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-103f4139-e85f-4d4e-a1ef-ae6e686f5410 req-249c76dd-5186-4411-8b6c-f404c8a43100 service nova] Acquiring lock "refresh_cache-dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:20:59.812807 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-103f4139-e85f-4d4e-a1ef-ae6e686f5410 req-249c76dd-5186-4411-8b6c-f404c8a43100 service nova] Acquired lock "refresh_cache-dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:20:59.812807 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-103f4139-e85f-4d4e-a1ef-ae6e686f5410 req-249c76dd-5186-4411-8b6c-f404c8a43100 service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Refreshing network info cache for port 3efc9a66-48a5-440c-b39f-8e74d8f7fc87 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:21:00.268066 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "refresh_cache-dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:21:00.315810 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-103f4139-e85f-4d4e-a1ef-ae6e686f5410 req-249c76dd-5186-4411-8b6c-f404c8a43100 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:21:00.389938 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-103f4139-e85f-4d4e-a1ef-ae6e686f5410 req-249c76dd-5186-4411-8b6c-f404c8a43100 service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:21:00.594226 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-103f4139-e85f-4d4e-a1ef-ae6e686f5410 req-249c76dd-5186-4411-8b6c-f404c8a43100 service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:21:00.801349 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:21:00.803313 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:21:00.804090 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Creating image(s) Jan 26 19:21:00.805102 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "/opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:00.805537 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "/opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:00.806708 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "/opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:00.869373 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:21:00.872734 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:21:00.875580 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:00.977329 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.101s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:00.977705 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:00.978165 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:00.978521 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:21:00.981257 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:21:00.981535 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:01.046385 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.064s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:01.046699 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:01.078141 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk 1073741824" returned: 0 in 0.031s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:01.078430 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.100s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:01.078700 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:01.098176 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-103f4139-e85f-4d4e-a1ef-ae6e686f5410 req-249c76dd-5186-4411-8b6c-f404c8a43100 service nova] Releasing lock "refresh_cache-dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:21:01.098886 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquired lock "refresh_cache-dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:21:01.099108 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:21:01.160957 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.082s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:01.161583 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:21:01.162141 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:01.249031 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:01.249423 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Cannot resize image /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:21:01.249796 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:21:01.250009 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Ensure instance console log exists: /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:21:01.250357 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:01.250610 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:01.250813 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:01.657609 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:21:01.771315 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:21:01.860392 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Updating instance_info_cache with network_info: [{"id": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "address": "fa:16:3e:6b:25:33", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efc9a66-48", "ovs_interfaceid": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:21:02.103910 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:02.364004 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Releasing lock "refresh_cache-dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:21:02.364512 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Instance network_info: |[{"id": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "address": "fa:16:3e:6b:25:33", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efc9a66-48", "ovs_interfaceid": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:21:02.368368 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Start _get_guest_xml network_info=[{"id": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "address": "fa:16:3e:6b:25:33", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efc9a66-48", "ovs_interfaceid": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:21:02.374388 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:21:02.375861 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='dbcbca53-6fab-4827-b3dc-a25e7eb6bb70'), owner=OwnerMeta(userid='d2494a2c41134b13a25b86d1bdfdd65f', username='tempest-AttachVolumeMultiAttachTest-1495503700-project-member', projectid='4a07dd99b19249acb501695a25608424', projectname='tempest-AttachVolumeMultiAttachTest-1495503700'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "address": "fa:16:3e:6b:25:33", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efc9a66-48", "ovs_interfaceid": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769473262.3753777) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:21:02.380813 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:21:02.380813 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:21:02.383621 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:21:02.384125 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:21:02.385431 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:21:02.385732 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:21:02.388794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:21:02.388794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:21:02.388794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:21:02.388794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:21:02.388794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:21:02.388794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:21:02.388794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:21:02.388794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:21:02.388794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:21:02.388794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:21:02.393130 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:20:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='multiattach-server-0',id=102,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2DqNsC6gMM/rMUhFP33wutEbCJfSUZoLXi4knAQI7cL83VCjf4w8Ol5UVNVyCMMM4G5N6GoZa1daASRvj6YYLKi4Cz6e/HnHlp1PtG4CCeiOBWtfpou2xsaXI9ivoyQw==',key_name='tempest-keypair-1141931557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-tbx0ak00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:20:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=dbcbca53-6fab-4827-b3dc-a25e7eb6bb70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "address": "fa:16:3e:6b:25:33", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efc9a66-48", "ovs_interfaceid": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:21:02.393405 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "address": "fa:16:3e:6b:25:33", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efc9a66-48", "ovs_interfaceid": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:21:02.394325 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:25:33,bridge_name='br-int',has_traffic_filtering=True,id=3efc9a66-48a5-440c-b39f-8e74d8f7fc87,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efc9a66-48') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:21:02.395813 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'pci_devices' on Instance uuid dbcbca53-6fab-4827-b3dc-a25e7eb6bb70 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] End _get_guest_xml xml= Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70 Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: instance-00000066 Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: multiattach-server-0 Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:21:02 Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: tempest-AttachVolumeMultiAttachTest-1495503700-project-member Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: tempest-AttachVolumeMultiAttachTest-1495503700 Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70 Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70 Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:02.899104 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:21:02.901562 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Preparing to wait for external event network-vif-plugged-3efc9a66-48a5-440c-b39f-8e74d8f7fc87 {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:21:02.901562 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:02.901562 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:02.901562 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:02.901562 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:20:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='multiattach-server-0',id=102,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2DqNsC6gMM/rMUhFP33wutEbCJfSUZoLXi4knAQI7cL83VCjf4w8Ol5UVNVyCMMM4G5N6GoZa1daASRvj6YYLKi4Cz6e/HnHlp1PtG4CCeiOBWtfpou2xsaXI9ivoyQw==',key_name='tempest-keypair-1141931557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-tbx0ak00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:20:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=dbcbca53-6fab-4827-b3dc-a25e7eb6bb70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "address": "fa:16:3e:6b:25:33", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efc9a66-48", "ovs_interfaceid": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:21:02.901862 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "address": "fa:16:3e:6b:25:33", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efc9a66-48", "ovs_interfaceid": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:21:02.901862 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:25:33,bridge_name='br-int',has_traffic_filtering=True,id=3efc9a66-48a5-440c-b39f-8e74d8f7fc87,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efc9a66-48') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:21:02.901862 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:25:33,bridge_name='br-int',has_traffic_filtering=True,id=3efc9a66-48a5-440c-b39f-8e74d8f7fc87,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efc9a66-48') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:21:02.901862 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:02.901862 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:21:02.902125 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:21:02.902659 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:02.902847 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0915e45-1850-5cc7-b275-a91725b01ad7', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:21:02.904006 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:02.906003 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:21:02.908235 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:02.908458 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3efc9a66-48, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:21:02.908809 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3efc9a66-48, col_values=(('qos', UUID('66c9462d-80c2-488f-b16e-bbf6b99baae8')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:21:02.908986 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3efc9a66-48, col_values=(('external_ids', {'iface-id': '3efc9a66-48a5-440c-b39f-8e74d8f7fc87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:25:33', 'vm-uuid': 'dbcbca53-6fab-4827-b3dc-a25e7eb6bb70'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:21:02.910054 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:02.912535 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:21:02.920452 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:02.921700 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:25:33,bridge_name='br-int',has_traffic_filtering=True,id=3efc9a66-48a5-440c-b39f-8e74d8f7fc87,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efc9a66-48') Jan 26 19:21:04.444628 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:21:04.445202 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:21:04.445267 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No VIF found with MAC fa:16:3e:6b:25:33, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:21:04.446058 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Using config drive Jan 26 19:21:04.958727 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:21:05.067172 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Creating config drive at /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk.config Jan 26 19:21:05.074420 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp9r9asvg7 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:05.217066 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp9r9asvg7" returned: 0 in 0.141s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:05.293306 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:05.303211 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:05.409161 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:05.410619 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:05.510224 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-32425cd7-9b0c-466f-aebe-cadf2e2cfd0c req-49c1cb99-2ca3-46cf-bbf5-3e9a82926ace service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Received event network-vif-plugged-3efc9a66-48a5-440c-b39f-8e74d8f7fc87 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:21:05.510651 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-32425cd7-9b0c-466f-aebe-cadf2e2cfd0c req-49c1cb99-2ca3-46cf-bbf5-3e9a82926ace service nova] Acquiring lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:05.510651 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-32425cd7-9b0c-466f-aebe-cadf2e2cfd0c req-49c1cb99-2ca3-46cf-bbf5-3e9a82926ace service nova] Lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:05.511615 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-32425cd7-9b0c-466f-aebe-cadf2e2cfd0c req-49c1cb99-2ca3-46cf-bbf5-3e9a82926ace service nova] Lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:05.511797 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-32425cd7-9b0c-466f-aebe-cadf2e2cfd0c req-49c1cb99-2ca3-46cf-bbf5-3e9a82926ace service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Processing event network-vif-plugged-3efc9a66-48a5-440c-b39f-8e74d8f7fc87 {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:21:05.530065 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:21:05.530065 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] VM Started (Lifecycle Event) Jan 26 19:21:05.534153 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:21:05.540976 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:21:05.544755 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Instance spawned successfully. Jan 26 19:21:05.545192 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:21:06.034240 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:21:06.039902 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:21:06.055226 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:21:06.055474 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:21:06.055699 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:21:06.055969 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:21:06.056293 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:21:06.056746 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:21:06.543935 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:21:06.544665 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:21:06.544665 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] VM Paused (Lifecycle Event) Jan 26 19:21:06.561994 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Took 5.76 seconds to spawn the instance on the hypervisor. Jan 26 19:21:06.562221 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:21:07.048982 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:21:07.053531 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:21:07.053741 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] VM Resumed (Lifecycle Event) Jan 26 19:21:07.077718 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Took 11.01 seconds to build instance. Jan 26 19:21:07.554886 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-96ec8c19-5f3f-41df-8aed-48a380ff7da9 req-386d4e34-9e40-4c2a-b038-78fb691ea1b5 service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Received event network-vif-plugged-3efc9a66-48a5-440c-b39f-8e74d8f7fc87 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:21:07.556232 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-96ec8c19-5f3f-41df-8aed-48a380ff7da9 req-386d4e34-9e40-4c2a-b038-78fb691ea1b5 service nova] Acquiring lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:07.556232 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-96ec8c19-5f3f-41df-8aed-48a380ff7da9 req-386d4e34-9e40-4c2a-b038-78fb691ea1b5 service nova] Lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:07.556232 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-96ec8c19-5f3f-41df-8aed-48a380ff7da9 req-386d4e34-9e40-4c2a-b038-78fb691ea1b5 service nova] Lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:07.556564 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-96ec8c19-5f3f-41df-8aed-48a380ff7da9 req-386d4e34-9e40-4c2a-b038-78fb691ea1b5 service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] No waiting events found dispatching network-vif-plugged-3efc9a66-48a5-440c-b39f-8e74d8f7fc87 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:21:07.557478 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-96ec8c19-5f3f-41df-8aed-48a380ff7da9 req-386d4e34-9e40-4c2a-b038-78fb691ea1b5 service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Received unexpected event network-vif-plugged-3efc9a66-48a5-440c-b39f-8e74d8f7fc87 for instance with vm_state active and task_state None. Jan 26 19:21:07.559606 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:21:07.569006 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:21:07.579673 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-346fdb85-5df1-4218-b709-381a5e8f2063 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 12.526s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:07.912044 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:08.359176 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:09.351999 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "28db8142-2f27-4207-923f-f2f525867805" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:09.351999 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "28db8142-2f27-4207-923f-f2f525867805" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:09.587253 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-03592f27-c6d8-40bb-91fd-cf0cb75386e4 req-d1337fa5-7ed8-4410-9640-6723a58eeffe service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Received event network-changed-3efc9a66-48a5-440c-b39f-8e74d8f7fc87 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:21:09.587469 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-03592f27-c6d8-40bb-91fd-cf0cb75386e4 req-d1337fa5-7ed8-4410-9640-6723a58eeffe service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Refreshing instance network info cache due to event network-changed-3efc9a66-48a5-440c-b39f-8e74d8f7fc87. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:21:09.587700 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-03592f27-c6d8-40bb-91fd-cf0cb75386e4 req-d1337fa5-7ed8-4410-9640-6723a58eeffe service nova] Acquiring lock "refresh_cache-dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:21:09.587956 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-03592f27-c6d8-40bb-91fd-cf0cb75386e4 req-d1337fa5-7ed8-4410-9640-6723a58eeffe service nova] Acquired lock "refresh_cache-dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:21:09.588153 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-03592f27-c6d8-40bb-91fd-cf0cb75386e4 req-d1337fa5-7ed8-4410-9640-6723a58eeffe service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Refreshing network info cache for port 3efc9a66-48a5-440c-b39f-8e74d8f7fc87 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:21:09.854938 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:21:10.090514 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-03592f27-c6d8-40bb-91fd-cf0cb75386e4 req-d1337fa5-7ed8-4410-9640-6723a58eeffe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:21:10.399303 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:10.399642 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:10.406012 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:21:10.406182 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Claim successful on node np0005596550.novalocal Jan 26 19:21:10.502186 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-03592f27-c6d8-40bb-91fd-cf0cb75386e4 req-d1337fa5-7ed8-4410-9640-6723a58eeffe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:21:10.608640 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-03592f27-c6d8-40bb-91fd-cf0cb75386e4 req-d1337fa5-7ed8-4410-9640-6723a58eeffe service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Updated VIF entry in instance network info cache for port 3efc9a66-48a5-440c-b39f-8e74d8f7fc87. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:21:10.609038 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-03592f27-c6d8-40bb-91fd-cf0cb75386e4 req-d1337fa5-7ed8-4410-9640-6723a58eeffe service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Updating instance_info_cache with network_info: [{"id": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "address": "fa:16:3e:6b:25:33", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efc9a66-48", "ovs_interfaceid": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:21:11.112651 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-03592f27-c6d8-40bb-91fd-cf0cb75386e4 req-d1337fa5-7ed8-4410-9640-6723a58eeffe service nova] Releasing lock "refresh_cache-dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:21:11.589273 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:21:12.093903 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:21:12.600093 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.200s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:12.600749 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:21:12.914210 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:13.110321 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:21:13.110321 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:21:13.110525 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:21:13.111196 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:21:13.220358 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2494a2c41134b13a25b86d1bdfdd65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a07dd99b19249acb501695a25608424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:21:13.386867 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:13.637120 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:21:13.775893 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Successfully created port: de19b0bb-1a2b-4b91-a960-201573fd49dd {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:21:14.145969 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:21:14.384325 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Successfully updated port: de19b0bb-1a2b-4b91-a960-201573fd49dd {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:21:14.416205 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6bd080ed-e9fd-432d-9c3b-02e1ee5338cf req-8ad385d9-6c45-4f7d-944a-0af39945a1d8 service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Received event network-changed-de19b0bb-1a2b-4b91-a960-201573fd49dd {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:21:14.416359 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6bd080ed-e9fd-432d-9c3b-02e1ee5338cf req-8ad385d9-6c45-4f7d-944a-0af39945a1d8 service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Refreshing instance network info cache due to event network-changed-de19b0bb-1a2b-4b91-a960-201573fd49dd. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:21:14.416570 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6bd080ed-e9fd-432d-9c3b-02e1ee5338cf req-8ad385d9-6c45-4f7d-944a-0af39945a1d8 service nova] Acquiring lock "refresh_cache-28db8142-2f27-4207-923f-f2f525867805" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:21:14.416691 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6bd080ed-e9fd-432d-9c3b-02e1ee5338cf req-8ad385d9-6c45-4f7d-944a-0af39945a1d8 service nova] Acquired lock "refresh_cache-28db8142-2f27-4207-923f-f2f525867805" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:21:14.416861 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-6bd080ed-e9fd-432d-9c3b-02e1ee5338cf req-8ad385d9-6c45-4f7d-944a-0af39945a1d8 service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Refreshing network info cache for port de19b0bb-1a2b-4b91-a960-201573fd49dd {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:21:14.890567 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "refresh_cache-28db8142-2f27-4207-923f-f2f525867805" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:21:14.925244 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-6bd080ed-e9fd-432d-9c3b-02e1ee5338cf req-8ad385d9-6c45-4f7d-944a-0af39945a1d8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:21:15.007688 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-6bd080ed-e9fd-432d-9c3b-02e1ee5338cf req-8ad385d9-6c45-4f7d-944a-0af39945a1d8 service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:21:15.155618 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-6bd080ed-e9fd-432d-9c3b-02e1ee5338cf req-8ad385d9-6c45-4f7d-944a-0af39945a1d8 service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:21:15.158077 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:21:15.159221 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:21:15.159573 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Creating image(s) Jan 26 19:21:15.160190 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "/opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:15.160462 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "/opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:15.161174 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "/opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:15.161946 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:21:15.165935 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:21:15.167318 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6bd080ed-e9fd-432d-9c3b-02e1ee5338cf req-8ad385d9-6c45-4f7d-944a-0af39945a1d8 service nova] Releasing lock "refresh_cache-28db8142-2f27-4207-923f-f2f525867805" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:21:15.167728 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquired lock "refresh_cache-28db8142-2f27-4207-923f-f2f525867805" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:21:15.168099 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:21:15.172379 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:15.249729 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:21:15.283771 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.114s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:15.284189 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:15.284641 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:15.285171 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:21:15.289798 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:21:15.290159 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:15.378898 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.087s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:15.378898 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:15.393242 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:21:15.417924 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk 1073741824" returned: 0 in 0.040s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:15.418205 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.133s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:15.421077 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:15.514046 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.094s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:15.514524 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:21:15.514873 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:15.530914 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Updating instance_info_cache with network_info: [{"id": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "address": "fa:16:3e:8b:61:75", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde19b0bb-1a", "ovs_interfaceid": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:21:15.607241 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:15.607671 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Cannot resize image /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:21:15.608179 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:21:15.608429 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Ensure instance console log exists: /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:21:15.608941 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:15.609251 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:15.609463 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:16.035561 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Releasing lock "refresh_cache-28db8142-2f27-4207-923f-f2f525867805" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:21:16.036141 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Instance network_info: |[{"id": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "address": "fa:16:3e:8b:61:75", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde19b0bb-1a", "ovs_interfaceid": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:21:16.039277 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Start _get_guest_xml network_info=[{"id": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "address": "fa:16:3e:8b:61:75", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde19b0bb-1a", "ovs_interfaceid": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:21:16.044735 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:21:16.046400 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='28db8142-2f27-4207-923f-f2f525867805'), owner=OwnerMeta(userid='d2494a2c41134b13a25b86d1bdfdd65f', username='tempest-AttachVolumeMultiAttachTest-1495503700-project-member', projectid='4a07dd99b19249acb501695a25608424', projectname='tempest-AttachVolumeMultiAttachTest-1495503700'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "address": "fa:16:3e:8b:61:75", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde19b0bb-1a", "ovs_interfaceid": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769473276.0458977) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:21:16.048350 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:21:16.048892 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:21:16.050689 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:21:16.051188 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:21:16.052495 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:21:16.053086 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:21:16.053330 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:21:16.053552 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:21:16.053810 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:21:16.054092 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:21:16.054305 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:21:16.054585 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:21:16.054813 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:21:16.055030 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:21:16.055290 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:21:16.055582 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:21:16.060579 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:21:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='multiattach-server-1',id=103,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2DqNsC6gMM/rMUhFP33wutEbCJfSUZoLXi4knAQI7cL83VCjf4w8Ol5UVNVyCMMM4G5N6GoZa1daASRvj6YYLKi4Cz6e/HnHlp1PtG4CCeiOBWtfpou2xsaXI9ivoyQw==',key_name='tempest-keypair-1141931557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-60cd0d0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=28db8142-2f27-4207-923f-f2f525867805,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "address": "fa:16:3e:8b:61:75", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde19b0bb-1a", "ovs_interfaceid": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:21:16.060865 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "address": "fa:16:3e:8b:61:75", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde19b0bb-1a", "ovs_interfaceid": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:21:16.061766 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:61:75,bridge_name='br-int',has_traffic_filtering=True,id=de19b0bb-1a2b-4b91-a960-201573fd49dd,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde19b0bb-1a') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:21:16.062619 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'pci_devices' on Instance uuid 28db8142-2f27-4207-923f-f2f525867805 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] End _get_guest_xml xml= Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: 28db8142-2f27-4207-923f-f2f525867805 Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: instance-00000067 Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: multiattach-server-1 Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:21:16 Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: tempest-AttachVolumeMultiAttachTest-1495503700-project-member Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: tempest-AttachVolumeMultiAttachTest-1495503700 Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: 28db8142-2f27-4207-923f-f2f525867805 Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: 28db8142-2f27-4207-923f-f2f525867805 Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:16.567728 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:21:16.571906 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Preparing to wait for external event network-vif-plugged-de19b0bb-1a2b-4b91-a960-201573fd49dd {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:21:16.571906 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "28db8142-2f27-4207-923f-f2f525867805-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:16.571906 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "28db8142-2f27-4207-923f-f2f525867805-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:16.571906 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "28db8142-2f27-4207-923f-f2f525867805-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:16.572130 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:21:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='multiattach-server-1',id=103,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2DqNsC6gMM/rMUhFP33wutEbCJfSUZoLXi4knAQI7cL83VCjf4w8Ol5UVNVyCMMM4G5N6GoZa1daASRvj6YYLKi4Cz6e/HnHlp1PtG4CCeiOBWtfpou2xsaXI9ivoyQw==',key_name='tempest-keypair-1141931557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-60cd0d0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=28db8142-2f27-4207-923f-f2f525867805,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "address": "fa:16:3e:8b:61:75", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde19b0bb-1a", "ovs_interfaceid": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:21:16.572553 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "address": "fa:16:3e:8b:61:75", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde19b0bb-1a", "ovs_interfaceid": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:21:16.573629 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:61:75,bridge_name='br-int',has_traffic_filtering=True,id=de19b0bb-1a2b-4b91-a960-201573fd49dd,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde19b0bb-1a') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:21:16.574294 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:61:75,bridge_name='br-int',has_traffic_filtering=True,id=de19b0bb-1a2b-4b91-a960-201573fd49dd,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde19b0bb-1a') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:21:16.575102 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:16.575755 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:21:16.576330 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:21:16.577631 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:16.578151 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd09f6fca-95b7-56e1-864a-45f9008f00c8', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:21:16.582812 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:16.582921 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:21:16.585293 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:16.589300 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:16.589729 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde19b0bb-1a, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:21:16.590404 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde19b0bb-1a, col_values=(('qos', UUID('3d7a46b4-0493-4d20-b25c-6d1914e24af1')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:21:16.590831 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde19b0bb-1a, col_values=(('external_ids', {'iface-id': 'de19b0bb-1a2b-4b91-a960-201573fd49dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:61:75', 'vm-uuid': '28db8142-2f27-4207-923f-f2f525867805'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:21:16.592818 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:16.595999 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:21:16.604482 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:16.605501 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:61:75,bridge_name='br-int',has_traffic_filtering=True,id=de19b0bb-1a2b-4b91-a960-201573fd49dd,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde19b0bb-1a') Jan 26 19:21:18.132175 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:21:18.133000 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:21:18.133000 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No VIF found with MAC fa:16:3e:8b:61:75, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:21:18.133800 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Using config drive Jan 26 19:21:18.418881 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:18.640640 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:21:18.769142 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Creating config drive at /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk.config Jan 26 19:21:18.772428 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpb7uae6sg {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:18.893493 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpb7uae6sg" returned: 0 in 0.120s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:18.970060 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:18.979145 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:18.985863 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:19.108110 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:19.109426 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:19.154870 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e2fba9c9-b506-416e-9e12-685c075771cd req-9e51c9ca-2dfe-4d7a-ad79-67df539d833b service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Received event network-vif-plugged-de19b0bb-1a2b-4b91-a960-201573fd49dd {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:21:19.155191 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e2fba9c9-b506-416e-9e12-685c075771cd req-9e51c9ca-2dfe-4d7a-ad79-67df539d833b service nova] Acquiring lock "28db8142-2f27-4207-923f-f2f525867805-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:19.155221 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e2fba9c9-b506-416e-9e12-685c075771cd req-9e51c9ca-2dfe-4d7a-ad79-67df539d833b service nova] Lock "28db8142-2f27-4207-923f-f2f525867805-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:19.155380 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e2fba9c9-b506-416e-9e12-685c075771cd req-9e51c9ca-2dfe-4d7a-ad79-67df539d833b service nova] Lock "28db8142-2f27-4207-923f-f2f525867805-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:19.155543 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e2fba9c9-b506-416e-9e12-685c075771cd req-9e51c9ca-2dfe-4d7a-ad79-67df539d833b service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Processing event network-vif-plugged-de19b0bb-1a2b-4b91-a960-201573fd49dd {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:21:19.159457 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:21:19.160107 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:21:19.160282 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 28db8142-2f27-4207-923f-f2f525867805] VM Started (Lifecycle Event) Jan 26 19:21:19.163626 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:21:19.166790 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 28db8142-2f27-4207-923f-f2f525867805] Instance spawned successfully. Jan 26 19:21:19.167033 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:21:19.664816 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 28db8142-2f27-4207-923f-f2f525867805] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:21:19.667533 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 28db8142-2f27-4207-923f-f2f525867805] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:21:19.672557 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:21:19.672823 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:21:19.673210 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:21:19.673480 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:21:19.673752 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:21:19.674041 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:21:20.172117 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 28db8142-2f27-4207-923f-f2f525867805] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:21:20.172718 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:21:20.172718 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 28db8142-2f27-4207-923f-f2f525867805] VM Paused (Lifecycle Event) Jan 26 19:21:20.178157 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Took 5.02 seconds to spawn the instance on the hypervisor. Jan 26 19:21:20.178337 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:21:20.675901 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 28db8142-2f27-4207-923f-f2f525867805] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:21:20.679704 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:21:20.679881 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 28db8142-2f27-4207-923f-f2f525867805] VM Resumed (Lifecycle Event) Jan 26 19:21:20.688584 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Took 10.33 seconds to build instance. Jan 26 19:21:21.184924 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 28db8142-2f27-4207-923f-f2f525867805] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:21:21.186590 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 28db8142-2f27-4207-923f-f2f525867805] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:21:21.195213 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7953eb25-5639-42b4-bead-dc06e58e3010 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "28db8142-2f27-4207-923f-f2f525867805" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 11.839s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:21.206018 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-022b93bd-73e5-448f-a071-ff77c76e3e37 req-d4c5f0b8-58a2-43fd-8009-db21d059d2f6 service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Received event network-changed-3efc9a66-48a5-440c-b39f-8e74d8f7fc87 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:21:21.206221 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-022b93bd-73e5-448f-a071-ff77c76e3e37 req-d4c5f0b8-58a2-43fd-8009-db21d059d2f6 service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Refreshing instance network info cache due to event network-changed-3efc9a66-48a5-440c-b39f-8e74d8f7fc87. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:21:21.206440 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-022b93bd-73e5-448f-a071-ff77c76e3e37 req-d4c5f0b8-58a2-43fd-8009-db21d059d2f6 service nova] Acquiring lock "refresh_cache-dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:21:21.206597 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-022b93bd-73e5-448f-a071-ff77c76e3e37 req-d4c5f0b8-58a2-43fd-8009-db21d059d2f6 service nova] Acquired lock "refresh_cache-dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:21:21.206852 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-022b93bd-73e5-448f-a071-ff77c76e3e37 req-d4c5f0b8-58a2-43fd-8009-db21d059d2f6 service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Refreshing network info cache for port 3efc9a66-48a5-440c-b39f-8e74d8f7fc87 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:21:21.226555 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3f228b08-c94d-4c02-a862-9d2eea89c447 req-a16910d5-a54b-4f23-980a-bc9c2fb47525 service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Received event network-vif-plugged-de19b0bb-1a2b-4b91-a960-201573fd49dd {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:21:21.228794 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3f228b08-c94d-4c02-a862-9d2eea89c447 req-a16910d5-a54b-4f23-980a-bc9c2fb47525 service nova] Acquiring lock "28db8142-2f27-4207-923f-f2f525867805-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:21.229149 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3f228b08-c94d-4c02-a862-9d2eea89c447 req-a16910d5-a54b-4f23-980a-bc9c2fb47525 service nova] Lock "28db8142-2f27-4207-923f-f2f525867805-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:21.229449 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3f228b08-c94d-4c02-a862-9d2eea89c447 req-a16910d5-a54b-4f23-980a-bc9c2fb47525 service nova] Lock "28db8142-2f27-4207-923f-f2f525867805-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:21.229941 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3f228b08-c94d-4c02-a862-9d2eea89c447 req-a16910d5-a54b-4f23-980a-bc9c2fb47525 service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] No waiting events found dispatching network-vif-plugged-de19b0bb-1a2b-4b91-a960-201573fd49dd {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:21:21.230230 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-3f228b08-c94d-4c02-a862-9d2eea89c447 req-a16910d5-a54b-4f23-980a-bc9c2fb47525 service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Received unexpected event network-vif-plugged-de19b0bb-1a2b-4b91-a960-201573fd49dd for instance with vm_state active and task_state None. Jan 26 19:21:21.592362 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:21.710544 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-022b93bd-73e5-448f-a071-ff77c76e3e37 req-d4c5f0b8-58a2-43fd-8009-db21d059d2f6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:21:21.973959 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-022b93bd-73e5-448f-a071-ff77c76e3e37 req-d4c5f0b8-58a2-43fd-8009-db21d059d2f6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:21:22.072382 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-022b93bd-73e5-448f-a071-ff77c76e3e37 req-d4c5f0b8-58a2-43fd-8009-db21d059d2f6 service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Updated VIF entry in instance network info cache for port 3efc9a66-48a5-440c-b39f-8e74d8f7fc87. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:21:22.072685 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-022b93bd-73e5-448f-a071-ff77c76e3e37 req-d4c5f0b8-58a2-43fd-8009-db21d059d2f6 service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Updating instance_info_cache with network_info: [{"id": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "address": "fa:16:3e:6b:25:33", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efc9a66-48", "ovs_interfaceid": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:21:22.575651 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-022b93bd-73e5-448f-a071-ff77c76e3e37 req-d4c5f0b8-58a2-43fd-8009-db21d059d2f6 service nova] Releasing lock "refresh_cache-dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:21:22.810713 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:22.811078 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:23.240420 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-572c4f62-acb1-4c87-b77d-155cff473f5a req-86142075-200b-4bfd-8d90-2abb3e34b12f service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Received event network-changed-de19b0bb-1a2b-4b91-a960-201573fd49dd {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:21:23.240790 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-572c4f62-acb1-4c87-b77d-155cff473f5a req-86142075-200b-4bfd-8d90-2abb3e34b12f service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Refreshing instance network info cache due to event network-changed-de19b0bb-1a2b-4b91-a960-201573fd49dd. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:21:23.241133 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-572c4f62-acb1-4c87-b77d-155cff473f5a req-86142075-200b-4bfd-8d90-2abb3e34b12f service nova] Acquiring lock "refresh_cache-28db8142-2f27-4207-923f-f2f525867805" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:21:23.241384 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-572c4f62-acb1-4c87-b77d-155cff473f5a req-86142075-200b-4bfd-8d90-2abb3e34b12f service nova] Acquired lock "refresh_cache-28db8142-2f27-4207-923f-f2f525867805" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:21:23.241877 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-572c4f62-acb1-4c87-b77d-155cff473f5a req-86142075-200b-4bfd-8d90-2abb3e34b12f service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Refreshing network info cache for port de19b0bb-1a2b-4b91-a960-201573fd49dd {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:21:23.314921 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'flavor' on Instance uuid dbcbca53-6fab-4827-b3dc-a25e7eb6bb70 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:21:23.420030 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:23.745417 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-572c4f62-acb1-4c87-b77d-155cff473f5a req-86142075-200b-4bfd-8d90-2abb3e34b12f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:21:24.039860 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-572c4f62-acb1-4c87-b77d-155cff473f5a req-86142075-200b-4bfd-8d90-2abb3e34b12f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:21:24.161869 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-572c4f62-acb1-4c87-b77d-155cff473f5a req-86142075-200b-4bfd-8d90-2abb3e34b12f service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Updated VIF entry in instance network info cache for port de19b0bb-1a2b-4b91-a960-201573fd49dd. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:21:24.162251 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-572c4f62-acb1-4c87-b77d-155cff473f5a req-86142075-200b-4bfd-8d90-2abb3e34b12f service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Updating instance_info_cache with network_info: [{"id": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "address": "fa:16:3e:8b:61:75", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde19b0bb-1a", "ovs_interfaceid": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:21:24.329663 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.518s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:24.667539 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-572c4f62-acb1-4c87-b77d-155cff473f5a req-86142075-200b-4bfd-8d90-2abb3e34b12f service nova] Releasing lock "refresh_cache-28db8142-2f27-4207-923f-f2f525867805" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:21:24.896051 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:21:25.542356 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:25.542614 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:25.542750 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Attaching volume 03b320c7-0da4-4321-b5d4-8845eae0115b to /dev/vdb Jan 26 19:21:25.582670 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': True, 'host': 'np0005596550.novalocal', 'execute': None}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:21:25.584017 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:25.590946 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:25.591052 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6df21d-28ef-4f02-881d-e24db669f195]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:25.592896 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[325cbb31-991e-46ac-b49a-0dc365576015]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:21:25.592896 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:21:25.592896 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:21:25.592896 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:21:25.592896 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:21:25.592896 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:21:25.592896 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:21:25.592896 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:21:25.592896 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:21:25.592896 np0005596550.novalocal nova-compute[189076]: with open_scini_device() as fd: Jan 26 19:21:25.592896 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:21:25.592896 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:21:25.592896 np0005596550.novalocal nova-compute[189076]: return next(self.gen) Jan 26 19:21:25.592896 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^ Jan 26 19:21:25.592896 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:21:25.592896 np0005596550.novalocal nova-compute[189076]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:21:25.592896 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:21:25.592896 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:21:25.593363 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[325cbb31-991e-46ac-b49a-0dc365576015]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:25.593673 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.scaleio [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:21:25.593818 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.scaleio [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:21:25.596027 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:25.602007 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:25.602451 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6962cf0-4f72-4c8d-921a-09680277a9f6]: (4, ('/dev/vda2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:25.603189 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:25.612117 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:25.612289 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41b5c2b-c869-4a46-b348-61130870989a]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:25.613207 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[6771c8bb-67dd-4059-81ae-f80f0695a7f3]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:25.613617 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): nvme version {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:25.633067 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] 'nvme version' failed. Not Retrying. {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:21:25.633333 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] nvme not present on system {{(pid=189076) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:21:25.634941 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=189076) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:21:25.635999 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.lightos [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fec2:720d', 'fe80::f4ec:16ff:fe16:3ba5', 'fe80::fc16:3eff:fe6b:2533', 'fe80::fc16:3eff:fe8b:6175'] Jan 26 19:21:25.636119 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:21:25.636262 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:21:25.636530 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] <== get_connector_properties: return (53ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': True, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fec2:720d', 'fe80::f4ec:16ff:fe16:3ba5', 'fe80::fc16:3eff:fe6b:2533', 'fe80::fc16:3eff:fe8b:6175']} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:21:25.636744 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.block_device [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Updating existing volume attachment record: 20356990-1660-4673-9575-3763b080d41e {{(pid=189076) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jan 26 19:21:26.594263 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:27.895378 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:21:28.400529 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:28.400734 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:28.400899 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:28.401038 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:21:28.421630 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:29.188812 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Calling os-brick to attach iSCSI Volume {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jan 26 19:21:29.188812 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b', 'target_lun': 0, 'volume_id': '03b320c7-0da4-4321-b5d4-8845eae0115b', 'auth_method': 'CHAP', 'auth_username': 'afS7J797gRF9JMZKLUHr', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:21:29.188812 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:21:29.189510 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:21:29.189826 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b', 'target_lun': 0, 'volume_id': '03b320c7-0da4-4321-b5d4-8845eae0115b', 'auth_method': 'CHAP', 'auth_username': 'afS7J797gRF9JMZKLUHr', 'auth_password': 'CjBQZVnFVfYG7M2Z', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True} {{(pid=189076) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:21:29.190986 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:29.198599 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:21:29.200212 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[07d53909-609f-4720-a0ad-6d720952a419]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:21:29.200212 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:21:29.200212 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:21:29.200212 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:21:29.200212 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:21:29.200212 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:21:29.200212 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:21:29.200212 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:21:29.200212 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:21:29.200212 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:21:29.200212 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:21:29.200212 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:21:29.200212 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:21:29.200212 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:21:29.200212 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:21:29.200212 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:21:29.200212 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:21:29.200212 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:21:29.200212 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:21:29.200212 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:21:29.200212 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:21:29.200212 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:21:29.203074 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d53909-609f-4720-a0ad-6d720952a419]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:29.203074 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:21:29.203074 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:21:29.203074 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:21:29.205783 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:29.222595 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260" returned: 21 in 0.018s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:29.222871 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c44d6e-c5cc-4848-98b4-af36d9cce496]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:29.223300 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:21:29.223300 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:21:29.224312 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --interface default --op new {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:29.238460 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:29.239644 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6473fd7-62a2-48e9-85c5-3021557852ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:29.241185 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b] added Jan 26 19:21:29.241185 np0005596550.novalocal nova-compute[189076]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:21:29.241185 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:21:29.241185 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:21:29.241185 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:21:29.241185 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=189076) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:21:29.241185 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.038(s), this was the 1st time calling it. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:21:29.241185 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:21:29.438785 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:29.524497 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:29.525373 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:29.596430 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk --force-share --output=json" returned: 0 in 0.071s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:29.601508 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:29.704572 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:29.705132 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:29.777300 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk --force-share --output=json" returned: 0 in 0.071s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:29.784152 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] skipping disk /dev/sda (vda) as it is a volume {{(pid=189076) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12209}} Jan 26 19:21:29.877790 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:21:29.877790 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:29.900545 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.024s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:29.901101 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=7079MB free_disk=371.7826843261719GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:21:29.901452 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:29.901831 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:30.242493 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:21:30.246239 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:30.253103 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:30.253405 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[b903cd8e-aed2-4ddd-b1b7-60c1c3e4a143]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.name = iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.tpgt = -1 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.startup = automatic Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.leading_login = No Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.iscsi_ifacename = default Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.net_ifacename = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.ipaddress = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.prefix_len = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.hwaddress = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.transport_name = tcp Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.initiatorname = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.state = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.vlan_id = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.vlan_priority = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.vlan_state = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.iface_num = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.mtu = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.port = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.bootproto = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.subnet_mask = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.gateway = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id_state = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.dhcp_dns = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.dhcp_learn_iqn = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.dhcp_req_vendor_id_state = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id_state = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.dhcp_slp_da = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.fragmentation = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.gratuitous_arp = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.incoming_forwarding = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.tos_state = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.tos = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.ttl = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.delayed_ack = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.tcp_nagle = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf_state = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.tcp_timer_scale = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.tcp_timestamp = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.redirect = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.def_task_mgmt_timeout = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.header_digest = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.data_digest = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.immediate_data = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.initial_r2t = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.data_seq_inorder = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.data_pdu_inorder = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.erl = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.max_receive_data_len = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.first_burst_len = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.max_outstanding_r2t = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.max_burst_len = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.chap_auth = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.bidi_chap = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.strict_login_compliance = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.discovery_auth = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: iface.discovery_logout = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.discovery_address = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.discovery_port = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.discovery_type = fw Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.initial_cmdsn = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.initial_login_retry_max = 8 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.xmit_thread_priority = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.cmds_max = 128 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.queue_depth = 32 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.nr_sessions = 1 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.auth.authmethod = None Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.auth.username = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.auth.password = *** Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.auth.username_in = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.auth.password_in = Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.timeo.replacement_timeout = 120 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FastAbort = Yes Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.InitialR2T = No Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ImmediateData = Yes Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxConnections = 1 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ERL = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.scan = auto Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.reopen_max = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.session.conn_reopen_log_freq = 1 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.conn[0].address = 38.102.83.18 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.conn[0].port = 3260 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.conn[0].startup = manual Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.window_size = 524288 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.DataDigest = None Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.IFMarker = No Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.OFMarker = No Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: # END RECORD Jan 26 19:21:30.254830 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:21:30.257282 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:30.272379 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.014s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:30.272379 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c39c49-2abc-4246-9f5d-1f630bdc6057]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:30.272379 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:21:30.274213 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:30.289417 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.015s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:30.289868 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d76efb-d05a-4502-bbc1-d86c8a260c25]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:30.290808 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:21:30.291822 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --op update -n node.session.auth.username -v afS7J797gRF9JMZKLUHr {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:30.301098 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --op update -n node.session.auth.username -v afS7J797gRF9JMZKLUHr" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:30.301498 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc75e8b2-c694-400b-a0b5-9e25ae1325b7]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:30.302164 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'afS7J797gRF9JMZKLUHr'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:21:30.306211 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:30.314010 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:30.315123 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[296bcec6-9cb6-441e-80d8-109a1a73c82c]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:30.316033 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:21:30.317657 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:30.330301 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:30.330674 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0bf295-936d-4c21-be29-abebc491af06]: (4, ('tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:30.332042 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:21:30.332042 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:21:30.332042 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsi session list stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:21:30.332042 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:21:30.333433 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --login {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:30.356814 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --login" returned: 0 in 0.022s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:30.356814 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c706797b-049e-4839-9ee6-53442a749663]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:30.357003 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b, portal: 38.102.83.18,3260] successful. Jan 26 19:21:30.357003 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:21:30.358556 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:30.370615 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:30.371050 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf38e0af-417a-45cf-8ed1-783ec375cb6e]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:30.371658 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:21:30.374559 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:30.387100 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.014s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:30.387534 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9321b6-6b52-49ec-9d69-b15c0bba884b]: (4, ('tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash)\ntcp: [29] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:30.388184 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:21:30.388184 np0005596550.novalocal nova-compute[189076]: tcp: [29] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b (non-flash) Jan 26 19:21:30.388184 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:21:30.388733 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsi session list stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:21:30.388733 np0005596550.novalocal nova-compute[189076]: tcp: [29] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b (non-flash) Jan 26 19:21:30.388733 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:21:30.390872 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:21:30.390872 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connected to 38.102.83.18:3260 {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:21:30.390872 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] HCTL ('3', '-', '-', 0) found on session 29 with lun 0 {{(pid=189076) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:21:30.391472 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Scanning host 3 c: -, t: -, l: 0) {{(pid=189076) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:21:30.392816 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host3/scan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:30.418359 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host3/scan" returned: 0 in 0.019s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:30.418359 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e7dc95-2a14-4b0f-b1a7-11e881510f67]: (4, ('- - 0', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:30.418359 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching for a device in session 29 and hctl ['3', '*', '*', 0] yield: None {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:21:30.963794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance a7010931-641e-45d6-a8df-edd43c91ae9b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:21:30.963794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance dbcbca53-6fab-4827-b3dc-a25e7eb6bb70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:21:30.963794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 28db8142-2f27-4207-923f-f2f525867805 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:21:30.963794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 3 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:21:30.963794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=1088MB phys_disk=399GB used_disk=2GB total_vcpus=8 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:21:29 up 49 min, 13 users, load average: 3.35, 4.01, 4.14\n', 'num_instances': '3', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '3', 'num_proj_4a07dd99b19249acb501695a25608424': '3', 'io_workload': '0'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:21:31.117754 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:21:31.421700 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching for a device in session 29 and hctl ['3', '*', '*', 0] yield: sdb {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:21:31.421700 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connected to sdb using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b', 'target_lun': 0, 'volume_id': '03b320c7-0da4-4321-b5d4-8845eae0115b', 'auth_method': 'CHAP', 'auth_username': 'afS7J797gRF9JMZKLUHr', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True} {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:21:31.421700 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.232s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:21:31.424007 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] <== connect_volume: return (2233ms) {'type': 'block', 'scsi_wwn': '36001405382d350d42b94512a2440a247', 'path': '/dev/sdb'} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:21:31.424498 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '36001405382d350d42b94512a2440a247', 'path': '/dev/sdb'} {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jan 26 19:21:31.428816 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'flavor' on Instance uuid dbcbca53-6fab-4827-b3dc-a25e7eb6bb70 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:21:31.595692 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:31.620049 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:21:31.937181 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] attach device xml: Jan 26 19:21:31.937181 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:31.937181 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:31.937181 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:31.937181 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:31.937181 np0005596550.novalocal nova-compute[189076]: 03b320c7-0da4-4321-b5d4-8845eae0115b Jan 26 19:21:31.937181 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:31.937181 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:31.937181 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:330}} Jan 26 19:21:32.130100 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:21:32.130100 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.228s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:33.131822 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:21:33.131822 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:21:33.131822 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:21:33.426853 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:33.509827 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:21:33.509827 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:21:33.509827 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:21:33.509827 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No VIF found with MAC fa:16:3e:6b:25:33, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:21:33.896314 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:21:35.138351 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-27726527-102c-4a25-b644-099ef1272393 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 9.594s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:35.643444 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "28db8142-2f27-4207-923f-f2f525867805" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:35.643444 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "28db8142-2f27-4207-923f-f2f525867805" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:36.147612 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'flavor' on Instance uuid 28db8142-2f27-4207-923f-f2f525867805 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:21:36.598098 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:37.154739 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "28db8142-2f27-4207-923f-f2f525867805" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.513s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:38.268999 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "28db8142-2f27-4207-923f-f2f525867805" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:38.269716 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "28db8142-2f27-4207-923f-f2f525867805" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:38.269716 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Attaching volume 03b320c7-0da4-4321-b5d4-8845eae0115b to /dev/vdb Jan 26 19:21:38.308458 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': True, 'host': 'np0005596550.novalocal', 'execute': None}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:21:38.309928 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:38.318131 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:38.318277 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e8689e-e9b2-408e-a54f-b9c380621cc5]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:38.320602 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[a80024a0-1334-48b6-b92f-33d0fe1107ff]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:21:38.320602 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:21:38.320602 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:21:38.320602 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:21:38.320602 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:21:38.320602 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:21:38.320602 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:21:38.320602 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:21:38.320602 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:21:38.320602 np0005596550.novalocal nova-compute[189076]: with open_scini_device() as fd: Jan 26 19:21:38.320602 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:21:38.320602 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:21:38.320602 np0005596550.novalocal nova-compute[189076]: return next(self.gen) Jan 26 19:21:38.320602 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^ Jan 26 19:21:38.320602 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:21:38.320602 np0005596550.novalocal nova-compute[189076]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:21:38.320602 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:21:38.320602 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:21:38.322403 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80024a0-1334-48b6-b92f-33d0fe1107ff]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:38.323606 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.scaleio [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:21:38.324014 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.scaleio [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:21:38.325053 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:38.336393 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:38.336647 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8ed9be-e85a-4610-a42d-66182ee7d353]: (4, ('/dev/vda2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:38.337900 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:38.353282 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.015s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:38.353857 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[17669ca6-5565-4e60-a069-7e45fc5f2acf]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:38.355071 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a5be14-6cd2-413d-9480-d2b1ebd2742c]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:38.355581 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): nvme version {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:38.383923 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] 'nvme version' failed. Not Retrying. {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:21:38.384249 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.nvmeof [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] nvme not present on system {{(pid=189076) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:21:38.385917 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=189076) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:21:38.386557 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.lightos [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fec2:720d', 'fe80::f4ec:16ff:fe16:3ba5', 'fe80::fc16:3eff:fe6b:2533', 'fe80::fc16:3eff:fe8b:6175'] Jan 26 19:21:38.386714 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:21:38.386885 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:21:38.387159 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] <== get_connector_properties: return (78ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': True, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fec2:720d', 'fe80::f4ec:16ff:fe16:3ba5', 'fe80::fc16:3eff:fe6b:2533', 'fe80::fc16:3eff:fe8b:6175']} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:21:38.387379 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.block_device [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Updating existing volume attachment record: ba00cd47-01c4-4e19-b701-93da8b767b62 {{(pid=189076) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jan 26 19:21:38.425878 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:38.892523 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:21:38.895276 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:21:38.895475 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:21:41.599645 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:41.932115 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Calling os-brick to attach iSCSI Volume {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jan 26 19:21:41.932720 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b', 'target_lun': 0, 'volume_id': '03b320c7-0da4-4321-b5d4-8845eae0115b', 'auth_method': 'CHAP', 'auth_username': 'afS7J797gRF9JMZKLUHr', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:21:41.932884 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:21:41.933223 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:21:41.933366 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b', 'target_lun': 0, 'volume_id': '03b320c7-0da4-4321-b5d4-8845eae0115b', 'auth_method': 'CHAP', 'auth_username': 'afS7J797gRF9JMZKLUHr', 'auth_password': 'CjBQZVnFVfYG7M2Z', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True} {{(pid=189076) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:21:41.936016 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:41.939637 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:21:41.941171 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[39792062-879d-45a4-b1b6-6601b9001403]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:21:41.941171 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:21:41.941171 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:21:41.941171 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:21:41.941171 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:21:41.941171 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:21:41.941171 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:21:41.941171 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:21:41.941171 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:21:41.941171 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:21:41.941171 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:21:41.941171 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:21:41.941171 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:21:41.941171 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:21:41.941171 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:21:41.941171 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:21:41.941171 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:21:41.941171 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:21:41.941171 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:21:41.941171 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:21:41.941171 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:21:41.941171 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:21:41.942232 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[39792062-879d-45a4-b1b6-6601b9001403]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:41.942893 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:21:41.943190 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:21:41.943378 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:21:41.944006 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:41.955419 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:41.955710 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[16783c24-d3d1-4422-b2b7-27b6dbbb5658]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = afS7J797gRF9JMZKLUHr\nnode.session.auth.password = ********\nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.name = iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.tpgt = -1 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.startup = automatic Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.leading_login = No Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.iscsi_ifacename = default Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.net_ifacename = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.ipaddress = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.prefix_len = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.hwaddress = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.transport_name = tcp Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.initiatorname = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.state = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.vlan_id = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.vlan_priority = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.vlan_state = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.iface_num = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.mtu = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.port = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.bootproto = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.subnet_mask = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.gateway = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id_state = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.dhcp_dns = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.dhcp_learn_iqn = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.dhcp_req_vendor_id_state = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id_state = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.dhcp_slp_da = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.fragmentation = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.gratuitous_arp = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.incoming_forwarding = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.tos_state = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.tos = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.ttl = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.delayed_ack = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.tcp_nagle = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf_state = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.tcp_timer_scale = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.tcp_timestamp = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.redirect = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.def_task_mgmt_timeout = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.header_digest = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.data_digest = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.immediate_data = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.initial_r2t = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.data_seq_inorder = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.data_pdu_inorder = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.erl = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.max_receive_data_len = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.first_burst_len = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.max_outstanding_r2t = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.max_burst_len = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.chap_auth = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.bidi_chap = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.strict_login_compliance = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.discovery_auth = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: iface.discovery_logout = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.discovery_address = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.discovery_port = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.discovery_type = fw Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.initial_cmdsn = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.initial_login_retry_max = 8 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.xmit_thread_priority = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.cmds_max = 128 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.queue_depth = 32 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.nr_sessions = 1 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.auth.authmethod = CHAP Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.auth.username = afS7J797gRF9JMZKLUHr Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.auth.password = *** Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.auth.username_in = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.auth.password_in = Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.timeo.replacement_timeout = 120 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FastAbort = Yes Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.InitialR2T = No Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ImmediateData = Yes Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxConnections = 1 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ERL = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.scan = manual Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.reopen_max = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.session.conn_reopen_log_freq = 1 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.conn[0].address = 38.102.83.18 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.conn[0].port = 3260 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.conn[0].startup = manual Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.window_size = 524288 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.DataDigest = None Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.IFMarker = No Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.OFMarker = No Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: # END RECORD Jan 26 19:21:41.959306 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:21:41.962231 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:41.971011 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:41.971550 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a63a82-5afb-41f9-852b-288555cf3dd3]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:41.971862 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:21:41.972466 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:41.980786 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:41.980786 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f47a6f-a5fc-45df-98fe-a6db3dad3243]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:41.980786 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:21:41.981267 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --op update -n node.session.auth.username -v afS7J797gRF9JMZKLUHr {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:41.990340 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --op update -n node.session.auth.username -v afS7J797gRF9JMZKLUHr" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:41.992007 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[f463248c-471b-4642-bfd6-ba6b0e888b3d]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:41.995067 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'afS7J797gRF9JMZKLUHr'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:21:41.999024 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:42.012234 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.014s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:42.012415 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7d5557-ede7-4ec2-9667-fd84cf75eca8]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:42.012947 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:21:42.013741 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:42.027864 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.014s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:42.028504 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[2155ee81-2c5a-421c-b476-41996118e5fd]: (4, ('tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash)\ntcp: [29] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:42.028861 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:21:42.028861 np0005596550.novalocal nova-compute[189076]: tcp: [29] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b (non-flash) Jan 26 19:21:42.028861 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:21:42.029100 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsi session list stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:21:42.029100 np0005596550.novalocal nova-compute[189076]: tcp: [29] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b (non-flash) Jan 26 19:21:42.029100 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:21:42.029478 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.086s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:21:42.029656 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connected to 38.102.83.18:3260 {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:21:42.030499 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] HCTL ('3', '0', '0', 0) found on session 29 with lun 0 {{(pid=189076) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:21:42.030685 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Scanning host 3 c: 0, t: 0, l: 0) {{(pid=189076) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:21:42.031617 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host3/scan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:42.040387 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host3/scan" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:42.040596 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dfc1c8-9cce-4427-938d-23ae47107fe7]: (4, ('0 0 0', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:42.041186 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching for a device in session 29 and hctl ('3', '0', '0', 0) yield: sdb {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:21:42.041745 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connected to sdb using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b', 'target_lun': 0, 'volume_id': '03b320c7-0da4-4321-b5d4-8845eae0115b', 'auth_method': 'CHAP', 'auth_username': 'afS7J797gRF9JMZKLUHr', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True} {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:21:42.045617 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.112s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:21:42.045994 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] <== connect_volume: return (113ms) {'type': 'block', 'scsi_wwn': '36001405382d350d42b94512a2440a247', 'path': '/dev/sdb'} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:21:42.046200 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '36001405382d350d42b94512a2440a247', 'path': '/dev/sdb'} {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jan 26 19:21:42.051427 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'flavor' on Instance uuid 28db8142-2f27-4207-923f-f2f525867805 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:21:42.558076 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] attach device xml: Jan 26 19:21:42.558076 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:42.558076 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:42.558076 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:42.558076 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:42.558076 np0005596550.novalocal nova-compute[189076]: 03b320c7-0da4-4321-b5d4-8845eae0115b Jan 26 19:21:42.558076 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:42.558076 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:42.558076 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:330}} Jan 26 19:21:42.892035 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:21:43.427223 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:44.206734 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:21:44.207197 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:21:44.207566 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:21:44.207919 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No VIF found with MAC fa:16:3e:8b:61:75, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:21:45.782950 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-369774f3-b679-430b-b86d-539317e9349b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "28db8142-2f27-4207-923f-f2f525867805" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.513s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:46.601537 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:46.927816 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-749c6e26-c2fb-47f8-a375-523e51006aef tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:46.928399 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-749c6e26-c2fb-47f8-a375-523e51006aef tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:47.431242 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-749c6e26-c2fb-47f8-a375-523e51006aef tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Detaching volume 03b320c7-0da4-4321-b5d4-8845eae0115b Jan 26 19:21:47.487706 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.block_device [None req-749c6e26-c2fb-47f8-a375-523e51006aef tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Attempting to driver detach volume 03b320c7-0da4-4321-b5d4-8845eae0115b from mountpoint /dev/vdb Jan 26 19:21:47.497155 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-749c6e26-c2fb-47f8-a375-523e51006aef tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Found disk vdb by alias ua-03b320c7-0da4-4321-b5d4-8845eae0115b {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:21:47.498617 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-749c6e26-c2fb-47f8-a375-523e51006aef tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Found disk vdb by alias ua-03b320c7-0da4-4321-b5d4-8845eae0115b {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:21:47.498791 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-749c6e26-c2fb-47f8-a375-523e51006aef tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Attempting to detach device vdb from instance dbcbca53-6fab-4827-b3dc-a25e7eb6bb70 from the persistent domain config. {{(pid=189076) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2599}} Jan 26 19:21:47.499070 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-749c6e26-c2fb-47f8-a375-523e51006aef tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] detach device xml: Jan 26 19:21:47.499070 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:47.499070 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:47.499070 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:47.499070 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:47.499070 np0005596550.novalocal nova-compute[189076]: 03b320c7-0da4-4321-b5d4-8845eae0115b Jan 26 19:21:47.499070 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:47.499070 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:21:47.499070 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:47.499070 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:21:47.582219 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-749c6e26-c2fb-47f8-a375-523e51006aef tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Found disk vdb by alias ua-03b320c7-0da4-4321-b5d4-8845eae0115b {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:21:47.582343 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-749c6e26-c2fb-47f8-a375-523e51006aef tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Failed to detach device vdb from instance dbcbca53-6fab-4827-b3dc-a25e7eb6bb70 from the persistent domain config. Libvirt did not report any error but the device is still in the config. Jan 26 19:21:47.582486 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-749c6e26-c2fb-47f8-a375-523e51006aef tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] (1/8): Attempting to detach device vdb with device alias ua-03b320c7-0da4-4321-b5d4-8845eae0115b from instance dbcbca53-6fab-4827-b3dc-a25e7eb6bb70 from the live domain config. {{(pid=189076) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2633}} Jan 26 19:21:47.582759 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-749c6e26-c2fb-47f8-a375-523e51006aef tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] detach device xml: Jan 26 19:21:47.582759 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:47.582759 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:47.582759 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:47.582759 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:47.582759 np0005596550.novalocal nova-compute[189076]: 03b320c7-0da4-4321-b5d4-8845eae0115b Jan 26 19:21:47.582759 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:47.582759 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:21:47.582759 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:47.582759 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:21:47.703195 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Received event ua-03b320c7-0da4-4321-b5d4-8845eae0115b> from libvirt while the driver is waiting for it; dispatched. {{(pid=189076) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2486}} Jan 26 19:21:47.706225 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-749c6e26-c2fb-47f8-a375-523e51006aef tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-03b320c7-0da4-4321-b5d4-8845eae0115b for instance dbcbca53-6fab-4827-b3dc-a25e7eb6bb70 {{(pid=189076) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2713}} Jan 26 19:21:47.708548 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-749c6e26-c2fb-47f8-a375-523e51006aef tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Successfully detached device vdb from instance dbcbca53-6fab-4827-b3dc-a25e7eb6bb70 from the live domain config. Jan 26 19:21:48.255928 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-749c6e26-c2fb-47f8-a375-523e51006aef tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Detected multiple connections on this host for volume: 03b320c7-0da4-4321-b5d4-8845eae0115b, skipping target disconnect. Jan 26 19:21:48.428898 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:48.816700 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-749c6e26-c2fb-47f8-a375-523e51006aef tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'flavor' on Instance uuid dbcbca53-6fab-4827-b3dc-a25e7eb6bb70 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:21:49.825549 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-749c6e26-c2fb-47f8-a375-523e51006aef tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 2.897s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:50.260116 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "28db8142-2f27-4207-923f-f2f525867805" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:50.260387 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "28db8142-2f27-4207-923f-f2f525867805" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:50.764225 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Detaching volume 03b320c7-0da4-4321-b5d4-8845eae0115b Jan 26 19:21:50.813590 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.block_device [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Attempting to driver detach volume 03b320c7-0da4-4321-b5d4-8845eae0115b from mountpoint /dev/vdb Jan 26 19:21:50.824670 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Found disk vdb by alias ua-03b320c7-0da4-4321-b5d4-8845eae0115b {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:21:50.826520 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Found disk vdb by alias ua-03b320c7-0da4-4321-b5d4-8845eae0115b {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:21:50.826809 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Attempting to detach device vdb from instance 28db8142-2f27-4207-923f-f2f525867805 from the persistent domain config. {{(pid=189076) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2599}} Jan 26 19:21:50.827195 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] detach device xml: Jan 26 19:21:50.827195 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:50.827195 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:50.827195 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:50.827195 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:50.827195 np0005596550.novalocal nova-compute[189076]: 03b320c7-0da4-4321-b5d4-8845eae0115b Jan 26 19:21:50.827195 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:50.827195 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:21:50.827195 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:50.827195 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:21:50.837192 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Found disk vdb by alias ua-03b320c7-0da4-4321-b5d4-8845eae0115b {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:21:50.837477 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Failed to detach device vdb from instance 28db8142-2f27-4207-923f-f2f525867805 from the persistent domain config. Libvirt did not report any error but the device is still in the config. Jan 26 19:21:50.837706 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] (1/8): Attempting to detach device vdb with device alias ua-03b320c7-0da4-4321-b5d4-8845eae0115b from instance 28db8142-2f27-4207-923f-f2f525867805 from the live domain config. {{(pid=189076) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2633}} Jan 26 19:21:50.838110 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] detach device xml: Jan 26 19:21:50.838110 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:50.838110 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:50.838110 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:50.838110 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:50.838110 np0005596550.novalocal nova-compute[189076]: 03b320c7-0da4-4321-b5d4-8845eae0115b Jan 26 19:21:50.838110 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:50.838110 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:21:50.838110 np0005596550.novalocal nova-compute[189076]: Jan 26 19:21:50.838110 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:21:50.970807 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Received event ua-03b320c7-0da4-4321-b5d4-8845eae0115b> from libvirt while the driver is waiting for it; dispatched. {{(pid=189076) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2486}} Jan 26 19:21:50.971289 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-03b320c7-0da4-4321-b5d4-8845eae0115b for instance 28db8142-2f27-4207-923f-f2f525867805 {{(pid=189076) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2713}} Jan 26 19:21:50.973699 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Successfully detached device vdb from instance 28db8142-2f27-4207-923f-f2f525867805 from the live domain config. Jan 26 19:21:51.000953 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] calling os-brick to detach iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jan 26 19:21:51.001250 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b', 'target_lun': 0, 'volume_id': '03b320c7-0da4-4321-b5d4-8845eae0115b', 'auth_method': 'CHAP', 'auth_username': 'afS7J797gRF9JMZKLUHr', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:21:51.001408 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:21:51.001721 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:21:51.004845 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:51.011897 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:51.012218 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f1174e-5a37-4fd8-b6d2-5e0a0bf78a7a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:51.012593 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:21:51.012593 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:21:51.012593 np0005596550.novalocal nova-compute[189076]: iSNS: Jan 26 19:21:51.012593 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:21:51.012593 np0005596550.novalocal nova-compute[189076]: STATIC: Jan 26 19:21:51.012593 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 Jan 26 19:21:51.012593 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:21:51.012593 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:21:51.012593 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b Jan 26 19:21:51.012593 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:21:51.012593 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:21:51.012593 np0005596550.novalocal nova-compute[189076]: FIRMWARE: Jan 26 19:21:51.012593 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:21:51.012593 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:21:51.012805 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:21:51.012805 np0005596550.novalocal nova-compute[189076]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:21:51.012805 np0005596550.novalocal nova-compute[189076]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=189076) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:21:51.013116 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b', 0)] {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:21:51.014544 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:51.022569 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:51.022760 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[708f6659-1a36-45dd-a8af-74f1071360a2]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b\n38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:51.023501 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:51.032069 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:51.032465 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd17ed05-8527-4b11-ab62-b72614929223]: (4, ('tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash)\ntcp: [29] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:51.032906 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:21:51.032906 np0005596550.novalocal nova-compute[189076]: tcp: [29] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b (non-flash) Jan 26 19:21:51.032906 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:21:51.033055 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsi session list stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:21:51.033055 np0005596550.novalocal nova-compute[189076]: tcp: [29] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b (non-flash) Jan 26 19:21:51.033055 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:21:51.033599 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Resulting device map defaultdict(. at 0x7fd7682eb1a0>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b'): ({'sdb'}, set())}) {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:21:51.033819 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Removing single pathed devices sdb {{(pid=189076) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:21:51.034501 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:51.039935 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:21:51.041187 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[b0efa217-0d64-4b78-b366-2d10d48c69b1]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:21:51.041187 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:21:51.041187 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:21:51.041187 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:21:51.041187 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:21:51.041187 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:21:51.041187 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:21:51.041187 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:21:51.041187 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:21:51.041187 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:21:51.041187 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:21:51.041187 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:21:51.041187 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:21:51.041187 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:21:51.041187 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:21:51.041187 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:21:51.041187 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:21:51.041187 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:21:51.041187 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:21:51.041187 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:21:51.041187 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:21:51.041187 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:21:51.042178 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0efa217-0d64-4b78-b366-2d10d48c69b1]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:51.042595 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Flushing IO for device /dev/sdb {{(pid=189076) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:21:51.043072 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:51.049106 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.006s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:51.049442 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fd96fd-7031-4204-bb20-c0bb6ea4aa96]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:51.049808 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=189076) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:21:51.050624 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:51.092631 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:51.092785 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[2314f474-5b27-4c2d-8092-492e89f2a33d]: (4, ('1', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:51.093118 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:21:51.093426 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] SCSI volumes sdb have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:21:51.093952 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b')] {{(pid=189076) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:21:51.094641 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:51.104483 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:51.104483 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffe2445-b3e6-4e0b-bc67-0fe7f538e7b5]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:51.104483 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:21:51.105223 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --logout {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:51.135413 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --logout" returned: 0 in 0.029s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:51.135413 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[864de63a-f8c1-483f-bf5d-4ff144497030]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b, portal: 38.102.83.18,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:51.135413 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b, portal: 38.102.83.18,3260] Jan 26 19:21:51.135413 np0005596550.novalocal nova-compute[189076]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b, portal: 38.102.83.18,3260] successful. Jan 26 19:21:51.135413 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:21:51.136171 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --op delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:21:51.145522 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-03b320c7-0da4-4321-b5d4-8845eae0115b -p 38.102.83.18:3260 --op delete" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:21:51.145926 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[658960f6-61ce-40e0-bd06-d4681a9e9608]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:21:51.146251 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:21:51.146642 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.145s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:21:51.146858 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] <== disconnect_volume: return (145ms) None {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:21:51.147050 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Disconnected iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jan 26 19:21:51.649000 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:53.430490 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:54.214080 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'flavor' on Instance uuid 28db8142-2f27-4207-923f-f2f525867805 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:21:55.223268 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-63863ca6-a4b2-492d-b353-abefebf1296d tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "28db8142-2f27-4207-923f-f2f525867805" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 4.963s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:56.610617 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "7985cac9-68f6-40e7-bb90-7761b4220db7" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:56.611197 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:56.684139 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:21:57.114305 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:21:57.664113 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:21:57.665236 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:21:57.669926 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:21:57.670144 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Claim successful on node np0005596550.novalocal Jan 26 19:21:58.831518 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:21:59.335656 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:21:59.842217 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.177s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:21:59.843143 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:22:00.350893 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:22:00.351084 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:22:00.351412 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:22:00.351701 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:22:00.644811 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2494a2c41134b13a25b86d1bdfdd65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a07dd99b19249acb501695a25608424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:22:00.875790 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:22:01.188964 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:01.335191 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Successfully created port: 2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:22:01.379184 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:22:01.732644 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:02.017879 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Successfully updated port: 2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:22:02.059334 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-839d68b9-0456-454d-ac34-5974cd2b8558 req-92c59a56-5c07-417d-a51c-bef11139ae0b service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Received event network-changed-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:22:02.059505 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-839d68b9-0456-454d-ac34-5974cd2b8558 req-92c59a56-5c07-417d-a51c-bef11139ae0b service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Refreshing instance network info cache due to event network-changed-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:22:02.059695 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-839d68b9-0456-454d-ac34-5974cd2b8558 req-92c59a56-5c07-417d-a51c-bef11139ae0b service nova] Acquiring lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:22:02.059908 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-839d68b9-0456-454d-ac34-5974cd2b8558 req-92c59a56-5c07-417d-a51c-bef11139ae0b service nova] Acquired lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:22:02.060055 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-839d68b9-0456-454d-ac34-5974cd2b8558 req-92c59a56-5c07-417d-a51c-bef11139ae0b service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Refreshing network info cache for port 2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:22:02.390638 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:22:02.392003 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:22:02.392476 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Creating image(s) Jan 26 19:22:02.393899 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "/opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:22:02.393899 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "/opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:22:02.394342 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "/opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:22:02.395329 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:22:02.399294 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:22:02.400639 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:02.520010 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.119s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:02.520684 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:22:02.521024 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:22:02.521346 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:22:02.521712 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:22:02.524358 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:22:02.524704 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:02.563642 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-839d68b9-0456-454d-ac34-5974cd2b8558 req-92c59a56-5c07-417d-a51c-bef11139ae0b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:22:02.616819 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-839d68b9-0456-454d-ac34-5974cd2b8558 req-92c59a56-5c07-417d-a51c-bef11139ae0b service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:22:02.634884 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.109s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:02.634884 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:02.684788 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk 1073741824" returned: 0 in 0.050s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:02.685214 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.164s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:22:02.685515 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:02.794015 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.108s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:02.794699 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:22:02.795202 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:02.812287 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-839d68b9-0456-454d-ac34-5974cd2b8558 req-92c59a56-5c07-417d-a51c-bef11139ae0b service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:22:02.895493 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:02.895799 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Cannot resize image /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:22:02.896150 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:22:02.896320 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Ensure instance console log exists: /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:22:02.896719 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:22:02.896975 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:22:02.897140 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:22:03.318503 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-839d68b9-0456-454d-ac34-5974cd2b8558 req-92c59a56-5c07-417d-a51c-bef11139ae0b service nova] Releasing lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:22:03.319502 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquired lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:22:03.320023 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:22:03.888822 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:22:04.027167 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:22:04.120825 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Updating instance_info_cache with network_info: [{"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:22:04.624190 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Releasing lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:22:04.625045 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Instance network_info: |[{"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:22:04.629654 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Start _get_guest_xml network_info=[{"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:22:04.634672 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:22:04.637237 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='7985cac9-68f6-40e7-bb90-7761b4220db7'), owner=OwnerMeta(userid='d2494a2c41134b13a25b86d1bdfdd65f', username='tempest-AttachVolumeMultiAttachTest-1495503700-project-member', projectid='4a07dd99b19249acb501695a25608424', projectname='tempest-AttachVolumeMultiAttachTest-1495503700'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769473324.6364927) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:22:04.639070 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:22:04.639899 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:22:04.641575 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:22:04.642377 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:22:04.644430 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:22:04.645231 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:22:04.645616 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:22:04.645998 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:22:04.646346 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:22:04.646611 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:22:04.647005 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:22:04.647508 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:22:04.648091 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:22:04.648453 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:22:04.648859 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:22:04.649264 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:22:04.656160 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:21:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='multiattach-server-0',id=104,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2DqNsC6gMM/rMUhFP33wutEbCJfSUZoLXi4knAQI7cL83VCjf4w8Ol5UVNVyCMMM4G5N6GoZa1daASRvj6YYLKi4Cz6e/HnHlp1PtG4CCeiOBWtfpou2xsaXI9ivoyQw==',key_name='tempest-keypair-1141931557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-1796nvkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:22:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=7985cac9-68f6-40e7-bb90-7761b4220db7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:22:04.656652 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:22:04.657943 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:38:7d,bridge_name='br-int',has_traffic_filtering=True,id=2a61c5d0-be1d-4c00-9d7b-8854ff697d7f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a61c5d0-be') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:22:04.659136 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'pci_devices' on Instance uuid 7985cac9-68f6-40e7-bb90-7761b4220db7 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] End _get_guest_xml xml= Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: 7985cac9-68f6-40e7-bb90-7761b4220db7 Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: instance-00000068 Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: multiattach-server-0 Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:22:04 Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: tempest-AttachVolumeMultiAttachTest-1495503700-project-member Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: tempest-AttachVolumeMultiAttachTest-1495503700 Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: 7985cac9-68f6-40e7-bb90-7761b4220db7 Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: 7985cac9-68f6-40e7-bb90-7761b4220db7 Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:05.164227 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:22:05.166620 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Preparing to wait for external event network-vif-plugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:22:05.166620 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:22:05.166620 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:22:05.166620 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:22:05.166620 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:21:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='multiattach-server-0',id=104,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2DqNsC6gMM/rMUhFP33wutEbCJfSUZoLXi4knAQI7cL83VCjf4w8Ol5UVNVyCMMM4G5N6GoZa1daASRvj6YYLKi4Cz6e/HnHlp1PtG4CCeiOBWtfpou2xsaXI9ivoyQw==',key_name='tempest-keypair-1141931557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-1796nvkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:22:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=7985cac9-68f6-40e7-bb90-7761b4220db7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:22:05.166982 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:22:05.167213 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:38:7d,bridge_name='br-int',has_traffic_filtering=True,id=2a61c5d0-be1d-4c00-9d7b-8854ff697d7f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a61c5d0-be') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:22:05.167536 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:38:7d,bridge_name='br-int',has_traffic_filtering=True,id=2a61c5d0-be1d-4c00-9d7b-8854ff697d7f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a61c5d0-be') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:22:05.168086 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:05.168503 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:22:05.168854 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:22:05.169658 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:05.169932 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b259db68-3c12-55f2-a273-7424d731a9e5', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:22:05.172814 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:05.172952 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:22:05.175585 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:05.175874 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a61c5d0-be, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:22:05.176310 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a61c5d0-be, col_values=(('qos', UUID('d3f70b27-98df-4ac9-9401-dd70273236a0')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:22:05.176581 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a61c5d0-be, col_values=(('external_ids', {'iface-id': '2a61c5d0-be1d-4c00-9d7b-8854ff697d7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:38:7d', 'vm-uuid': '7985cac9-68f6-40e7-bb90-7761b4220db7'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:22:05.178512 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:05.181289 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:22:05.185213 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:05.186626 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:38:7d,bridge_name='br-int',has_traffic_filtering=True,id=2a61c5d0-be1d-4c00-9d7b-8854ff697d7f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a61c5d0-be') Jan 26 19:22:06.709302 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:22:06.709673 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:22:06.709673 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No VIF found with MAC fa:16:3e:9a:38:7d, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:22:06.710046 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Using config drive Jan 26 19:22:07.216355 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:22:07.294556 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Creating config drive at /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk.config Jan 26 19:22:07.298731 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp13x_qcbp {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:07.427708 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp13x_qcbp" returned: 0 in 0.129s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:07.493363 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:07.501739 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:07.504461 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:07.636955 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d48b61a4-173e-4642-9049-853a493fea57 req-26042ee6-28fe-43fd-8039-50c95cddfabc service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Received event network-vif-plugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:22:07.636955 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d48b61a4-173e-4642-9049-853a493fea57 req-26042ee6-28fe-43fd-8039-50c95cddfabc service nova] Acquiring lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:22:07.636955 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d48b61a4-173e-4642-9049-853a493fea57 req-26042ee6-28fe-43fd-8039-50c95cddfabc service nova] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:22:07.636955 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d48b61a4-173e-4642-9049-853a493fea57 req-26042ee6-28fe-43fd-8039-50c95cddfabc service nova] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:22:07.636955 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d48b61a4-173e-4642-9049-853a493fea57 req-26042ee6-28fe-43fd-8039-50c95cddfabc service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Processing event network-vif-plugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:22:07.636955 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:07.672909 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:22:07.672909 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] VM Started (Lifecycle Event) Jan 26 19:22:07.672909 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:22:07.679395 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:22:07.684635 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Instance spawned successfully. Jan 26 19:22:07.685465 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:22:08.177587 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:22:08.182600 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:22:08.192696 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:22:08.192857 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:22:08.193124 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:22:08.193362 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:22:08.193635 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:22:08.193907 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:22:08.435416 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:08.686021 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:22:08.686233 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:22:08.686552 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] VM Paused (Lifecycle Event) Jan 26 19:22:08.699141 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Took 6.31 seconds to spawn the instance on the hypervisor. Jan 26 19:22:08.699378 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:22:09.189599 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:22:09.193429 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:22:09.193602 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] VM Resumed (Lifecycle Event) Jan 26 19:22:09.214089 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Took 11.59 seconds to build instance. Jan 26 19:22:09.676318 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b4a243cc-5328-4be8-be88-c98702309bb9 req-b3ceac2b-80fa-44e6-a53a-410e8379f227 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Received event network-vif-plugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:22:09.676652 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b4a243cc-5328-4be8-be88-c98702309bb9 req-b3ceac2b-80fa-44e6-a53a-410e8379f227 service nova] Acquiring lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:22:09.677096 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b4a243cc-5328-4be8-be88-c98702309bb9 req-b3ceac2b-80fa-44e6-a53a-410e8379f227 service nova] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:22:09.677312 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b4a243cc-5328-4be8-be88-c98702309bb9 req-b3ceac2b-80fa-44e6-a53a-410e8379f227 service nova] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:22:09.677508 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b4a243cc-5328-4be8-be88-c98702309bb9 req-b3ceac2b-80fa-44e6-a53a-410e8379f227 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] No waiting events found dispatching network-vif-plugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:22:09.677729 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-b4a243cc-5328-4be8-be88-c98702309bb9 req-b3ceac2b-80fa-44e6-a53a-410e8379f227 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Received unexpected event network-vif-plugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f for instance with vm_state active and task_state None. Jan 26 19:22:09.696950 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:22:09.699681 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:22:09.719338 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a62c2aac-f35e-4abf-8979-42c312bb6799 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 13.108s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:22:10.205407 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:10.692807 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e5423e0d-f2f8-405a-95d0-c310da259762 req-6d7f7ab8-d3f7-43f1-96cd-b1fd4308588a service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Received event network-changed-de19b0bb-1a2b-4b91-a960-201573fd49dd {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:22:10.693308 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e5423e0d-f2f8-405a-95d0-c310da259762 req-6d7f7ab8-d3f7-43f1-96cd-b1fd4308588a service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Refreshing instance network info cache due to event network-changed-de19b0bb-1a2b-4b91-a960-201573fd49dd. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:22:10.694112 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e5423e0d-f2f8-405a-95d0-c310da259762 req-6d7f7ab8-d3f7-43f1-96cd-b1fd4308588a service nova] Acquiring lock "refresh_cache-28db8142-2f27-4207-923f-f2f525867805" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:22:10.694308 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e5423e0d-f2f8-405a-95d0-c310da259762 req-6d7f7ab8-d3f7-43f1-96cd-b1fd4308588a service nova] Acquired lock "refresh_cache-28db8142-2f27-4207-923f-f2f525867805" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:22:10.694551 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-e5423e0d-f2f8-405a-95d0-c310da259762 req-6d7f7ab8-d3f7-43f1-96cd-b1fd4308588a service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Refreshing network info cache for port de19b0bb-1a2b-4b91-a960-201573fd49dd {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:22:11.199067 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-e5423e0d-f2f8-405a-95d0-c310da259762 req-6d7f7ab8-d3f7-43f1-96cd-b1fd4308588a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:22:11.466168 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-e5423e0d-f2f8-405a-95d0-c310da259762 req-6d7f7ab8-d3f7-43f1-96cd-b1fd4308588a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:22:11.589996 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-e5423e0d-f2f8-405a-95d0-c310da259762 req-6d7f7ab8-d3f7-43f1-96cd-b1fd4308588a service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Updated VIF entry in instance network info cache for port de19b0bb-1a2b-4b91-a960-201573fd49dd. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:22:11.590363 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-e5423e0d-f2f8-405a-95d0-c310da259762 req-6d7f7ab8-d3f7-43f1-96cd-b1fd4308588a service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Updating instance_info_cache with network_info: [{"id": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "address": "fa:16:3e:8b:61:75", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde19b0bb-1a", "ovs_interfaceid": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:22:12.092869 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e5423e0d-f2f8-405a-95d0-c310da259762 req-6d7f7ab8-d3f7-43f1-96cd-b1fd4308588a service nova] Releasing lock "refresh_cache-28db8142-2f27-4207-923f-f2f525867805" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:22:12.756413 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c464a8ac-271a-4889-9304-f021e54b03af req-5b6fe0c5-78e6-4fa4-bec5-cdd3e1ca3151 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Received event network-changed-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:22:12.757125 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-c464a8ac-271a-4889-9304-f021e54b03af req-5b6fe0c5-78e6-4fa4-bec5-cdd3e1ca3151 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Refreshing instance network info cache due to event network-changed-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:22:12.757125 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c464a8ac-271a-4889-9304-f021e54b03af req-5b6fe0c5-78e6-4fa4-bec5-cdd3e1ca3151 service nova] Acquiring lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:22:12.757125 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c464a8ac-271a-4889-9304-f021e54b03af req-5b6fe0c5-78e6-4fa4-bec5-cdd3e1ca3151 service nova] Acquired lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:22:12.757125 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-c464a8ac-271a-4889-9304-f021e54b03af req-5b6fe0c5-78e6-4fa4-bec5-cdd3e1ca3151 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Refreshing network info cache for port 2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:22:13.085806 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "03068296-12d4-4dbe-9770-c070e336a3bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:22:13.086052 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "03068296-12d4-4dbe-9770-c070e336a3bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:22:13.259345 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-c464a8ac-271a-4889-9304-f021e54b03af req-5b6fe0c5-78e6-4fa4-bec5-cdd3e1ca3151 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:22:13.589267 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:22:13.764618 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-c464a8ac-271a-4889-9304-f021e54b03af req-5b6fe0c5-78e6-4fa4-bec5-cdd3e1ca3151 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:22:13.873175 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-c464a8ac-271a-4889-9304-f021e54b03af req-5b6fe0c5-78e6-4fa4-bec5-cdd3e1ca3151 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Updated VIF entry in instance network info cache for port 2a61c5d0-be1d-4c00-9d7b-8854ff697d7f. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:22:13.873175 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-c464a8ac-271a-4889-9304-f021e54b03af req-5b6fe0c5-78e6-4fa4-bec5-cdd3e1ca3151 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Updating instance_info_cache with network_info: [{"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:22:14.142983 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:22:14.143190 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:22:14.146655 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:22:14.146862 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Claim successful on node np0005596550.novalocal Jan 26 19:22:14.376991 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-c464a8ac-271a-4889-9304-f021e54b03af req-5b6fe0c5-78e6-4fa4-bec5-cdd3e1ca3151 service nova] Releasing lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:22:15.208357 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:22:15.254310 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:22:15.254310 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5048 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:22:15.254310 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:22:15.254310 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:22:15.255752 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:15.359499 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:22:15.863147 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:22:16.370257 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.227s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:22:16.371104 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:22:16.881445 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:22:16.882833 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:22:16.882833 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:22:16.882899 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:22:16.975084 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2494a2c41134b13a25b86d1bdfdd65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a07dd99b19249acb501695a25608424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:22:17.414541 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:22:17.575942 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Successfully created port: c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:22:17.916664 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:22:18.021224 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Successfully updated port: c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:22:18.062707 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-1422841a-c35a-40eb-bc70-72326d091ab0 req-d4929e13-4bc4-426c-a181-f530fbfe9415 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Received event network-changed-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:22:18.063100 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-1422841a-c35a-40eb-bc70-72326d091ab0 req-d4929e13-4bc4-426c-a181-f530fbfe9415 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Refreshing instance network info cache due to event network-changed-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:22:18.063825 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1422841a-c35a-40eb-bc70-72326d091ab0 req-d4929e13-4bc4-426c-a181-f530fbfe9415 service nova] Acquiring lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:22:18.064153 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1422841a-c35a-40eb-bc70-72326d091ab0 req-d4929e13-4bc4-426c-a181-f530fbfe9415 service nova] Acquired lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:22:18.064451 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-1422841a-c35a-40eb-bc70-72326d091ab0 req-d4929e13-4bc4-426c-a181-f530fbfe9415 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Refreshing network info cache for port c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:22:18.438179 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:18.525167 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:22:18.570559 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-1422841a-c35a-40eb-bc70-72326d091ab0 req-d4929e13-4bc4-426c-a181-f530fbfe9415 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:22:18.636319 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-1422841a-c35a-40eb-bc70-72326d091ab0 req-d4929e13-4bc4-426c-a181-f530fbfe9415 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:22:18.763312 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-1422841a-c35a-40eb-bc70-72326d091ab0 req-d4929e13-4bc4-426c-a181-f530fbfe9415 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:22:18.926398 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:22:18.927259 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:22:18.927512 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Creating image(s) Jan 26 19:22:18.928008 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "/opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:22:18.928182 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "/opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:22:18.928683 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "/opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:22:18.929232 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:22:18.932135 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:22:18.933441 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:19.045458 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.112s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:19.045743 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:22:19.046150 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:22:19.046524 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:22:19.049277 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:22:19.049619 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:19.115840 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.066s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:19.116297 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:19.151858 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk 1073741824" returned: 0 in 0.035s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:19.152249 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.106s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:22:19.152630 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:19.224449 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.071s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:19.224843 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:22:19.225131 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:19.269412 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1422841a-c35a-40eb-bc70-72326d091ab0 req-d4929e13-4bc4-426c-a181-f530fbfe9415 service nova] Releasing lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:22:19.270332 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquired lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:22:19.270687 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:22:19.300680 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:19.301197 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Cannot resize image /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:22:19.301742 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:22:19.302079 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Ensure instance console log exists: /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:22:19.302572 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:22:19.302974 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:22:19.303268 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:22:19.838467 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:22:19.950530 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:22:20.049484 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Updating instance_info_cache with network_info: [{"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:22:20.295177 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:20.552664 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Releasing lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:22:20.553017 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Instance network_info: |[{"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:22:20.554751 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Start _get_guest_xml network_info=[{"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:22:20.558395 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:22:20.559576 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='03068296-12d4-4dbe-9770-c070e336a3bf'), owner=OwnerMeta(userid='d2494a2c41134b13a25b86d1bdfdd65f', username='tempest-AttachVolumeMultiAttachTest-1495503700-project-member', projectid='4a07dd99b19249acb501695a25608424', projectname='tempest-AttachVolumeMultiAttachTest-1495503700'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769473340.5591028) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:22:20.561100 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:22:20.561401 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:22:20.563547 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:22:20.564195 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:22:20.565854 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:22:20.566494 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:22:20.566877 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:22:20.567151 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:22:20.567468 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:22:20.567721 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:22:20.568022 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:22:20.568414 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:22:20.568685 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:22:20.569006 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:22:20.569282 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:22:20.569565 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:22:20.574548 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:22:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='multiattach-server-1',id=105,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2DqNsC6gMM/rMUhFP33wutEbCJfSUZoLXi4knAQI7cL83VCjf4w8Ol5UVNVyCMMM4G5N6GoZa1daASRvj6YYLKi4Cz6e/HnHlp1PtG4CCeiOBWtfpou2xsaXI9ivoyQw==',key_name='tempest-keypair-1141931557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-yxpzl051',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:22:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=03068296-12d4-4dbe-9770-c070e336a3bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:22:20.574929 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:22:20.575899 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:65:1e,bridge_name='br-int',has_traffic_filtering=True,id=c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0932d0a-9e') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:22:20.576885 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'pci_devices' on Instance uuid 03068296-12d4-4dbe-9770-c070e336a3bf {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] End _get_guest_xml xml= Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: 03068296-12d4-4dbe-9770-c070e336a3bf Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: instance-00000069 Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: multiattach-server-1 Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:22:20 Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: tempest-AttachVolumeMultiAttachTest-1495503700-project-member Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: tempest-AttachVolumeMultiAttachTest-1495503700 Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: 03068296-12d4-4dbe-9770-c070e336a3bf Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: 03068296-12d4-4dbe-9770-c070e336a3bf Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:21.081667 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:22:21.083162 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Preparing to wait for external event network-vif-plugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:22:21.083162 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:22:21.083162 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:22:21.083162 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:22:21.083560 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:22:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='multiattach-server-1',id=105,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2DqNsC6gMM/rMUhFP33wutEbCJfSUZoLXi4knAQI7cL83VCjf4w8Ol5UVNVyCMMM4G5N6GoZa1daASRvj6YYLKi4Cz6e/HnHlp1PtG4CCeiOBWtfpou2xsaXI9ivoyQw==',key_name='tempest-keypair-1141931557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-yxpzl051',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:22:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=03068296-12d4-4dbe-9770-c070e336a3bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:22:21.083841 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:22:21.084461 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:65:1e,bridge_name='br-int',has_traffic_filtering=True,id=c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0932d0a-9e') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:22:21.084824 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:65:1e,bridge_name='br-int',has_traffic_filtering=True,id=c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0932d0a-9e') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:22:21.085289 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:21.085625 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:22:21.085976 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:22:21.086832 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:21.087073 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e3a78d3-1501-5394-8771-23c32066d1ac', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:22:21.088098 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:21.090378 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:21.092801 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:21.093042 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0932d0a-9e, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:22:21.093454 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc0932d0a-9e, col_values=(('qos', UUID('a37e91f6-ffd1-4ca6-82c0-b4e396fa896e')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:22:21.093670 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc0932d0a-9e, col_values=(('external_ids', {'iface-id': 'c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:65:1e', 'vm-uuid': '03068296-12d4-4dbe-9770-c070e336a3bf'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:22:21.094626 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:21.097494 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:22:21.103859 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:21.105190 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:65:1e,bridge_name='br-int',has_traffic_filtering=True,id=c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0932d0a-9e') Jan 26 19:22:22.662057 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:22:22.663737 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:22:22.663737 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No VIF found with MAC fa:16:3e:64:65:1e, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:22:22.663737 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Using config drive Jan 26 19:22:23.172360 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:22:23.300470 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Creating config drive at /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk.config Jan 26 19:22:23.308819 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpq9f945i_ {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:23.442806 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpq9f945i_" returned: 0 in 0.134s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:23.542317 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:23.550559 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:23.554783 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:23.555260 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:23.678448 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:23.682939 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:23.728526 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:22:23.728744 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] VM Started (Lifecycle Event) Jan 26 19:22:23.785162 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a39648f3-6587-4d06-9816-edbc8dcbd33b req-d4a79300-eb25-45a5-836b-1ec81caf6341 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Received event network-vif-plugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:22:23.785162 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a39648f3-6587-4d06-9816-edbc8dcbd33b req-d4a79300-eb25-45a5-836b-1ec81caf6341 service nova] Acquiring lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:22:23.785462 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a39648f3-6587-4d06-9816-edbc8dcbd33b req-d4a79300-eb25-45a5-836b-1ec81caf6341 service nova] Lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:22:23.785462 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a39648f3-6587-4d06-9816-edbc8dcbd33b req-d4a79300-eb25-45a5-836b-1ec81caf6341 service nova] Lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:22:23.785606 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a39648f3-6587-4d06-9816-edbc8dcbd33b req-d4a79300-eb25-45a5-836b-1ec81caf6341 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Processing event network-vif-plugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:22:23.789294 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:22:23.799553 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:22:23.808192 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Instance spawned successfully. Jan 26 19:22:23.808545 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:22:24.233144 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:22:24.243806 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:22:24.322626 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:22:24.323090 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:22:24.323550 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:22:24.323954 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:22:24.324380 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:22:24.324830 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:22:24.748884 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:22:24.748884 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:22:24.748884 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] VM Paused (Lifecycle Event) Jan 26 19:22:24.832844 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Took 5.91 seconds to spawn the instance on the hypervisor. Jan 26 19:22:24.833557 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:22:24.895952 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:22:25.254206 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:22:25.258331 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:22:25.258331 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] VM Resumed (Lifecycle Event) Jan 26 19:22:25.349273 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Took 11.25 seconds to build instance. Jan 26 19:22:25.760740 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:22:25.773975 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:22:25.833026 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e9b9aa32-a0fb-494e-a7ac-8035601babdc req-efe1e4ed-17be-4827-aa2e-c4ffa6284580 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Received event network-vif-plugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:22:25.833978 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e9b9aa32-a0fb-494e-a7ac-8035601babdc req-efe1e4ed-17be-4827-aa2e-c4ffa6284580 service nova] Acquiring lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:22:25.834348 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e9b9aa32-a0fb-494e-a7ac-8035601babdc req-efe1e4ed-17be-4827-aa2e-c4ffa6284580 service nova] Lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.004s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:22:25.837581 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e9b9aa32-a0fb-494e-a7ac-8035601babdc req-efe1e4ed-17be-4827-aa2e-c4ffa6284580 service nova] Lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:22:25.837581 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e9b9aa32-a0fb-494e-a7ac-8035601babdc req-efe1e4ed-17be-4827-aa2e-c4ffa6284580 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] No waiting events found dispatching network-vif-plugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:22:25.837581 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-e9b9aa32-a0fb-494e-a7ac-8035601babdc req-efe1e4ed-17be-4827-aa2e-c4ffa6284580 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Received unexpected event network-vif-plugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f for instance with vm_state active and task_state None. Jan 26 19:22:25.851614 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-fdbd68e5-cbf8-4bc4-b606-dcf843945384 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "03068296-12d4-4dbe-9770-c070e336a3bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 12.765s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:22:26.096043 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:26.618857 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-1669cbf6-e586-4aaa-9c87-5a8372985a42 req-aafa1f49-c962-47db-9a7f-3c4604e0de44 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Received event network-changed-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:22:26.619004 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-1669cbf6-e586-4aaa-9c87-5a8372985a42 req-aafa1f49-c962-47db-9a7f-3c4604e0de44 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Refreshing instance network info cache due to event network-changed-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:22:26.619174 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1669cbf6-e586-4aaa-9c87-5a8372985a42 req-aafa1f49-c962-47db-9a7f-3c4604e0de44 service nova] Acquiring lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:22:26.619603 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1669cbf6-e586-4aaa-9c87-5a8372985a42 req-aafa1f49-c962-47db-9a7f-3c4604e0de44 service nova] Acquired lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:22:26.619830 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-1669cbf6-e586-4aaa-9c87-5a8372985a42 req-aafa1f49-c962-47db-9a7f-3c4604e0de44 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Refreshing network info cache for port 2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:22:27.122434 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-1669cbf6-e586-4aaa-9c87-5a8372985a42 req-aafa1f49-c962-47db-9a7f-3c4604e0de44 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:22:27.354782 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-1669cbf6-e586-4aaa-9c87-5a8372985a42 req-aafa1f49-c962-47db-9a7f-3c4604e0de44 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:22:27.468419 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-1669cbf6-e586-4aaa-9c87-5a8372985a42 req-aafa1f49-c962-47db-9a7f-3c4604e0de44 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Updated VIF entry in instance network info cache for port 2a61c5d0-be1d-4c00-9d7b-8854ff697d7f. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:22:27.468419 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-1669cbf6-e586-4aaa-9c87-5a8372985a42 req-aafa1f49-c962-47db-9a7f-3c4604e0de44 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Updating instance_info_cache with network_info: [{"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:22:27.971440 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1669cbf6-e586-4aaa-9c87-5a8372985a42 req-aafa1f49-c962-47db-9a7f-3c4604e0de44 service nova] Releasing lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:22:28.185785 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "7985cac9-68f6-40e7-bb90-7761b4220db7" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:22:28.185785 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:22:28.441587 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:28.654268 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-9cc7efcb-5f2d-4442-8c53-a876cf62a7c0 req-94f4798e-b502-423f-8435-7b4f2753bad9 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Received event network-changed-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:22:28.654477 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-9cc7efcb-5f2d-4442-8c53-a876cf62a7c0 req-94f4798e-b502-423f-8435-7b4f2753bad9 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Refreshing instance network info cache due to event network-changed-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:22:28.654730 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-9cc7efcb-5f2d-4442-8c53-a876cf62a7c0 req-94f4798e-b502-423f-8435-7b4f2753bad9 service nova] Acquiring lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:22:28.655008 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-9cc7efcb-5f2d-4442-8c53-a876cf62a7c0 req-94f4798e-b502-423f-8435-7b4f2753bad9 service nova] Acquired lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:22:28.655209 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-9cc7efcb-5f2d-4442-8c53-a876cf62a7c0 req-94f4798e-b502-423f-8435-7b4f2753bad9 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Refreshing network info cache for port c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:22:28.688787 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'flavor' on Instance uuid 7985cac9-68f6-40e7-bb90-7761b4220db7 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:22:28.895201 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:22:29.160266 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-9cc7efcb-5f2d-4442-8c53-a876cf62a7c0 req-94f4798e-b502-423f-8435-7b4f2753bad9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:22:29.422960 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:22:29.422960 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:22:29.423621 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:22:29.423929 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:22:29.501571 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-9cc7efcb-5f2d-4442-8c53-a876cf62a7c0 req-94f4798e-b502-423f-8435-7b4f2753bad9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:22:29.598176 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-9cc7efcb-5f2d-4442-8c53-a876cf62a7c0 req-94f4798e-b502-423f-8435-7b4f2753bad9 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Updated VIF entry in instance network info cache for port c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:22:29.598708 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-9cc7efcb-5f2d-4442-8c53-a876cf62a7c0 req-94f4798e-b502-423f-8435-7b4f2753bad9 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Updating instance_info_cache with network_info: [{"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:22:29.695314 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.510s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:22:30.103075 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-9cc7efcb-5f2d-4442-8c53-a876cf62a7c0 req-94f4798e-b502-423f-8435-7b4f2753bad9 service nova] Releasing lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:22:30.492855 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:30.598017 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:30.598017 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:30.690951 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:30.695227 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:30.756590 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk --force-share --output=json" returned: 0 in 0.061s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:30.757382 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:30.818140 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "7985cac9-68f6-40e7-bb90-7761b4220db7" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:22:30.818645 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:22:30.819099 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Attaching volume d13d5015-aabd-4db2-9327-ec66ee53bafe to /dev/vdb Jan 26 19:22:30.861974 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:30.867255 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:30.882589 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': True, 'host': 'np0005596550.novalocal', 'execute': None}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:22:30.885392 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:30.891056 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.006s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:30.891346 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[72250e7c-3697-4e6f-bfb1-36ecfe3bfd46]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:30.893842 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[261e0ae3-1610-455b-b9c0-27c1f8f5f866]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:22:30.893842 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:22:30.893842 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:22:30.893842 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:22:30.893842 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:22:30.893842 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:22:30.893842 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:22:30.893842 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:22:30.893842 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:22:30.893842 np0005596550.novalocal nova-compute[189076]: with open_scini_device() as fd: Jan 26 19:22:30.893842 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:22:30.893842 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:22:30.893842 np0005596550.novalocal nova-compute[189076]: return next(self.gen) Jan 26 19:22:30.893842 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^ Jan 26 19:22:30.893842 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:22:30.893842 np0005596550.novalocal nova-compute[189076]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:22:30.893842 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:22:30.893842 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:22:30.894535 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[261e0ae3-1610-455b-b9c0-27c1f8f5f866]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:30.895516 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.scaleio [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:22:30.895516 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.scaleio [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:22:30.895980 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:30.904174 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:30.904416 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2c8305-b161-4872-9e74-ae99eeb328de]: (4, ('/dev/vda2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:30.905059 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:30.911746 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:30.914076 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[92798c92-b8f6-43a6-b5ea-bf216fa55276]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:30.915277 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af40da5-3d6d-4581-aaa4-af72ba5b18f1]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:30.915659 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): nvme version {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:30.929804 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] 'nvme version' failed. Not Retrying. {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:22:30.930209 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] nvme not present on system {{(pid=189076) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:22:30.931465 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=189076) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:22:30.932197 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.lightos [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fec2:720d', 'fe80::f4ec:16ff:fe16:3ba5', 'fe80::fc16:3eff:fe6b:2533', 'fe80::fc16:3eff:fe8b:6175', 'fe80::fc16:3eff:fe9a:387d', 'fe80::fc16:3eff:fe64:651e'] Jan 26 19:22:30.932423 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:22:30.932598 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:22:30.932934 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] <== get_connector_properties: return (50ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': True, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fec2:720d', 'fe80::f4ec:16ff:fe16:3ba5', 'fe80::fc16:3eff:fe6b:2533', 'fe80::fc16:3eff:fe8b:6175', 'fe80::fc16:3eff:fe9a:387d', 'fe80::fc16:3eff:fe64:651e']} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:22:30.933369 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.block_device [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Updating existing volume attachment record: eb57ee41-ea7b-46f5-a13e-0c5cad8355cf {{(pid=189076) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jan 26 19:22:30.939990 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk --force-share --output=json" returned: 0 in 0.073s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:30.940347 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:31.035319 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:31.039841 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] skipping disk /dev/sda (vda) as it is a volume {{(pid=189076) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12209}} Jan 26 19:22:31.047036 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:31.097635 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:31.144817 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:31.145569 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:31.248957 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:31.333471 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:22:31.334980 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:31.350637 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.015s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:31.351149 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=6537MB free_disk=371.7129364013672GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:22:31.351400 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:22:31.351663 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:22:32.402946 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance a7010931-641e-45d6-a8df-edd43c91ae9b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:22:32.403215 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance dbcbca53-6fab-4827-b3dc-a25e7eb6bb70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:22:32.403322 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 28db8142-2f27-4207-923f-f2f525867805 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:22:32.403469 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 7985cac9-68f6-40e7-bb90-7761b4220db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:22:32.403642 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 03068296-12d4-4dbe-9770-c070e336a3bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:22:32.407057 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 5 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:22:32.407263 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=1472MB phys_disk=399GB used_disk=4GB total_vcpus=8 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:22:31 up 50 min, 14 users, load average: 3.00, 3.74, 4.03\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '5', 'num_proj_4a07dd99b19249acb501695a25608424': '5', 'io_workload': '0'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:22:32.598899 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:22:33.101837 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:22:33.441447 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:33.607521 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:22:33.607707 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.256s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:22:34.481501 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Calling os-brick to attach iSCSI Volume {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jan 26 19:22:34.482144 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe', 'target_lun': 0, 'volume_id': 'd13d5015-aabd-4db2-9327-ec66ee53bafe', 'auth_method': 'CHAP', 'auth_username': 't27GCDUif9ZHfCH3yDUn', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:22:34.482297 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:22:34.482668 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:22:34.482841 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe', 'target_lun': 0, 'volume_id': 'd13d5015-aabd-4db2-9327-ec66ee53bafe', 'auth_method': 'CHAP', 'auth_username': 't27GCDUif9ZHfCH3yDUn', 'auth_password': '8wKKK5H2F7ThGsAY', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True} {{(pid=189076) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:22:34.483619 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:34.490606 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:22:34.492532 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[ae6a0b33-b955-45d7-ab2e-eae9fb1756de]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:22:34.492532 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:22:34.492532 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:22:34.492532 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:22:34.492532 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:22:34.492532 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:22:34.492532 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:22:34.492532 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:22:34.492532 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:22:34.492532 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:22:34.492532 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:22:34.492532 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:22:34.492532 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:22:34.492532 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:22:34.492532 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:22:34.492532 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:22:34.492532 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:22:34.492532 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:22:34.492532 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:22:34.492532 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:22:34.492532 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:22:34.492532 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:22:34.493451 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6a0b33-b955-45d7-ab2e-eae9fb1756de]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:34.494028 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:22:34.494438 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:22:34.494660 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:22:34.495297 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:34.506675 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260" returned: 21 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:34.507107 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0fd5d2-9988-4779-9d41-9841338529ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:34.507804 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:22:34.507804 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:22:34.508912 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --interface default --op new {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:34.518726 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:34.522603 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11844c8-5abd-4611-871f-7bafec006dba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:34.523001 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe] added Jan 26 19:22:34.523001 np0005596550.novalocal nova-compute[189076]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:22:34.523001 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:22:34.523001 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:22:34.523001 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:22:34.523187 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=189076) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:22:34.523476 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.029(s), this was the 1st time calling it. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:22:34.523749 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:22:35.525308 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:22:35.526667 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:35.539420 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:35.539886 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d224b777-40f9-4f31-b526-a27b2de69ea1]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.name = iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.tpgt = -1 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.startup = automatic Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.leading_login = No Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.iscsi_ifacename = default Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.net_ifacename = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.ipaddress = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.prefix_len = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.hwaddress = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.transport_name = tcp Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.initiatorname = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.state = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.vlan_id = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.vlan_priority = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.vlan_state = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.iface_num = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.mtu = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.port = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.bootproto = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.subnet_mask = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.gateway = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id_state = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.dhcp_dns = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.dhcp_learn_iqn = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.dhcp_req_vendor_id_state = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id_state = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.dhcp_slp_da = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.fragmentation = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.gratuitous_arp = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.incoming_forwarding = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.tos_state = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.tos = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.ttl = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.delayed_ack = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.tcp_nagle = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf_state = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.tcp_timer_scale = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.tcp_timestamp = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.redirect = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.def_task_mgmt_timeout = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.header_digest = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.data_digest = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.immediate_data = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.initial_r2t = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.data_seq_inorder = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.data_pdu_inorder = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.erl = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.max_receive_data_len = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.first_burst_len = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.max_outstanding_r2t = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.max_burst_len = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.chap_auth = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.bidi_chap = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.strict_login_compliance = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.discovery_auth = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: iface.discovery_logout = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.discovery_address = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.discovery_port = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.discovery_type = fw Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.initial_cmdsn = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.initial_login_retry_max = 8 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.xmit_thread_priority = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.cmds_max = 128 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.queue_depth = 32 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.nr_sessions = 1 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.auth.authmethod = None Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.auth.username = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.auth.password = *** Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.auth.username_in = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.auth.password_in = Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.timeo.replacement_timeout = 120 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FastAbort = Yes Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.InitialR2T = No Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ImmediateData = Yes Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxConnections = 1 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ERL = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.scan = auto Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.reopen_max = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.session.conn_reopen_log_freq = 1 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.conn[0].address = 38.102.83.18 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.conn[0].port = 3260 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.conn[0].startup = manual Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.window_size = 524288 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.DataDigest = None Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.IFMarker = No Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.OFMarker = No Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: # END RECORD Jan 26 19:22:35.542447 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:22:35.546322 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:35.556136 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:35.556339 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a54315b-96d6-4067-b27f-4dfeffd28973]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:35.556560 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:22:35.557213 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:35.567437 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:35.567650 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[01043961-bbeb-4b0d-8097-9abd2bca9d22]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:35.567925 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:22:35.568481 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.username -v t27GCDUif9ZHfCH3yDUn {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:35.575932 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.username -v t27GCDUif9ZHfCH3yDUn" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:35.576080 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c8e16a-3b22-4167-b8fb-7234b13571cd]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:35.576304 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 't27GCDUif9ZHfCH3yDUn'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:22:35.576980 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:35.587720 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:35.587883 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc426238-3c03-4d20-b771-ed94a16312b9]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:35.588297 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:22:35.588850 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:35.597019 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:35.597801 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb4987d-b425-440c-9007-96ea0963bdf4]: (4, ('tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:35.597801 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:22:35.597801 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:22:35.597925 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsi session list stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:22:35.597925 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:22:35.598640 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --login {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:35.608223 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:22:35.608448 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:22:35.608655 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:22:35.608888 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:22:35.622881 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --login" returned: 0 in 0.023s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:35.622881 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9716e8-bdd7-413b-a831-2405ba245b50]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:35.622881 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe, portal: 38.102.83.18,3260] successful. Jan 26 19:22:35.622881 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:22:35.623861 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:35.634403 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:35.634583 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd8db3b-df8d-40a4-8400-6ee99328a23a]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:35.635017 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:22:35.635702 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:35.645001 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:35.645207 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb433ed5-80c6-4253-b0da-fc4705b22f50]: (4, ('tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash)\ntcp: [30] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:35.645734 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:22:35.645734 np0005596550.novalocal nova-compute[189076]: tcp: [30] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe (non-flash) Jan 26 19:22:35.645734 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:22:35.646006 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsi session list stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:22:35.646006 np0005596550.novalocal nova-compute[189076]: tcp: [30] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe (non-flash) Jan 26 19:22:35.646006 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:22:35.646549 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:22:35.646873 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connected to 38.102.83.18:3260 {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:22:35.647477 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] HCTL ('3', '-', '-', 0) found on session 30 with lun 0 {{(pid=189076) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:22:35.647712 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Scanning host 3 c: -, t: -, l: 0) {{(pid=189076) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:22:35.649786 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host3/scan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:35.665826 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host3/scan" returned: 0 in 0.016s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:35.666051 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[701065b9-b1c3-4f3a-9226-a9388bd7af6d]: (4, ('- - 0', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:35.666959 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching for a device in session 30 and hctl ['3', '*', '*', 0] yield: None {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:22:36.099012 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:36.668475 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching for a device in session 30 and hctl ['3', '*', '*', 0] yield: sdb {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:22:36.669172 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connected to sdb using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe', 'target_lun': 0, 'volume_id': 'd13d5015-aabd-4db2-9327-ec66ee53bafe', 'auth_method': 'CHAP', 'auth_username': 't27GCDUif9ZHfCH3yDUn', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True} {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:22:36.669585 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.187s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:22:36.669889 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] <== connect_volume: return (2187ms) {'type': 'block', 'scsi_wwn': '3600140528028ae1b6c44b1bbb2023c5c', 'path': '/dev/sdb'} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:22:36.670135 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3600140528028ae1b6c44b1bbb2023c5c', 'path': '/dev/sdb'} {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jan 26 19:22:36.674403 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'flavor' on Instance uuid 7985cac9-68f6-40e7-bb90-7761b4220db7 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:22:37.180153 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] attach device xml: Jan 26 19:22:37.180153 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:37.180153 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:37.180153 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:37.180153 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:37.180153 np0005596550.novalocal nova-compute[189076]: d13d5015-aabd-4db2-9327-ec66ee53bafe Jan 26 19:22:37.180153 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:37.180153 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:37.180153 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:330}} Jan 26 19:22:38.444731 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:38.868792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:22:38.868792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:22:38.868792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:22:38.868792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No VIF found with MAC fa:16:3e:9a:38:7d, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:22:38.893006 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:22:38.894737 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:22:38.895035 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:22:40.421334 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-7a490e03-b681-4a42-bab7-a148b6070213 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 9.602s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:22:40.859881 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "03068296-12d4-4dbe-9770-c070e336a3bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:22:40.860055 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "03068296-12d4-4dbe-9770-c070e336a3bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:22:41.099911 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:41.363956 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'flavor' on Instance uuid 03068296-12d4-4dbe-9770-c070e336a3bf {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:22:42.372053 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "03068296-12d4-4dbe-9770-c070e336a3bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.511s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:22:43.444609 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:43.455588 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "03068296-12d4-4dbe-9770-c070e336a3bf" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:22:43.455985 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "03068296-12d4-4dbe-9770-c070e336a3bf" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:22:43.456382 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Attaching volume d13d5015-aabd-4db2-9327-ec66ee53bafe to /dev/vdb Jan 26 19:22:43.496237 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': True, 'host': 'np0005596550.novalocal', 'execute': None}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:22:43.497855 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:43.504251 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:43.504661 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[194fff89-40b5-4bb7-94d4-4fa1ac7c0ee5]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:43.507473 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[ea034e72-8f50-4653-a491-ad3c8570f092]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:22:43.507473 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:22:43.507473 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:22:43.507473 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:22:43.507473 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:22:43.507473 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:22:43.507473 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:22:43.507473 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:22:43.507473 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:22:43.507473 np0005596550.novalocal nova-compute[189076]: with open_scini_device() as fd: Jan 26 19:22:43.507473 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:22:43.507473 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:22:43.507473 np0005596550.novalocal nova-compute[189076]: return next(self.gen) Jan 26 19:22:43.507473 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^ Jan 26 19:22:43.507473 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:22:43.507473 np0005596550.novalocal nova-compute[189076]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:22:43.507473 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:22:43.507473 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:22:43.507864 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea034e72-8f50-4653-a491-ad3c8570f092]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:43.508331 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.scaleio [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:22:43.508641 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.scaleio [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:22:43.509663 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:43.516927 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:43.517133 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[360e2b77-7777-4337-a4b7-0c534cbca8fa]: (4, ('/dev/vda2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:43.517916 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:43.523220 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.005s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:43.523518 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a837b81-bffa-41fc-8d0a-6f3bab7a9f3f]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:43.524863 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2a65dc-a7f6-4b78-b0e8-63111582593e]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:43.525245 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): nvme version {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:43.548810 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] 'nvme version' failed. Not Retrying. {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:22:43.548810 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] nvme not present on system {{(pid=189076) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:22:43.550516 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=189076) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:22:43.552406 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.lightos [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fec2:720d', 'fe80::f4ec:16ff:fe16:3ba5', 'fe80::fc16:3eff:fe6b:2533', 'fe80::fc16:3eff:fe8b:6175', 'fe80::fc16:3eff:fe9a:387d', 'fe80::fc16:3eff:fe64:651e'] Jan 26 19:22:43.552954 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:22:43.554071 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:22:43.554131 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] <== get_connector_properties: return (56ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': True, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fec2:720d', 'fe80::f4ec:16ff:fe16:3ba5', 'fe80::fc16:3eff:fe6b:2533', 'fe80::fc16:3eff:fe8b:6175', 'fe80::fc16:3eff:fe9a:387d', 'fe80::fc16:3eff:fe64:651e']} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:22:43.554724 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.block_device [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Updating existing volume attachment record: 9baeab3e-dc0b-4cbd-8bf1-9a3d5aa59974 {{(pid=189076) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jan 26 19:22:46.101908 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:47.628577 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Calling os-brick to attach iSCSI Volume {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jan 26 19:22:47.629231 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe', 'target_lun': 0, 'volume_id': 'd13d5015-aabd-4db2-9327-ec66ee53bafe', 'auth_method': 'CHAP', 'auth_username': 't27GCDUif9ZHfCH3yDUn', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:22:47.629373 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:22:47.629757 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:22:47.629927 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe', 'target_lun': 0, 'volume_id': 'd13d5015-aabd-4db2-9327-ec66ee53bafe', 'auth_method': 'CHAP', 'auth_username': 't27GCDUif9ZHfCH3yDUn', 'auth_password': '8wKKK5H2F7ThGsAY', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True} {{(pid=189076) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:22:47.632081 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:47.637386 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:22:47.642018 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[52d777a3-20cb-4345-96b0-3e00139c4355]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:22:47.642018 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:22:47.642018 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:22:47.642018 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:22:47.642018 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:22:47.642018 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:22:47.642018 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:22:47.642018 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:22:47.642018 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:22:47.642018 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:22:47.642018 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:22:47.642018 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:22:47.642018 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:22:47.642018 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:22:47.642018 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:22:47.642018 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:22:47.642018 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:22:47.642018 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:22:47.642018 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:22:47.642018 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:22:47.642018 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:22:47.642018 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:22:47.642657 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d777a3-20cb-4345-96b0-3e00139c4355]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:47.643034 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:22:47.643286 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:22:47.643465 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:22:47.644287 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:47.652703 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:47.654030 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a091d432-8e92-4fb6-b0c6-46acbd7db7e1]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = t27GCDUif9ZHfCH3yDUn\nnode.session.auth.password = ********\nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.name = iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.tpgt = -1 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.startup = automatic Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.leading_login = No Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.iscsi_ifacename = default Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.net_ifacename = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.ipaddress = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.prefix_len = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.hwaddress = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.transport_name = tcp Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.initiatorname = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.state = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.vlan_id = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.vlan_priority = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.vlan_state = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.iface_num = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.mtu = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.port = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.bootproto = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.subnet_mask = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.gateway = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id_state = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.dhcp_dns = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.dhcp_learn_iqn = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.dhcp_req_vendor_id_state = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id_state = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.dhcp_slp_da = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.fragmentation = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.gratuitous_arp = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.incoming_forwarding = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.tos_state = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.tos = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.ttl = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.delayed_ack = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.tcp_nagle = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf_state = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.tcp_timer_scale = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.tcp_timestamp = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.redirect = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.def_task_mgmt_timeout = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.header_digest = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.data_digest = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.immediate_data = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.initial_r2t = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.data_seq_inorder = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.data_pdu_inorder = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.erl = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.max_receive_data_len = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.first_burst_len = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.max_outstanding_r2t = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.max_burst_len = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.chap_auth = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.bidi_chap = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.strict_login_compliance = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.discovery_auth = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: iface.discovery_logout = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.discovery_address = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.discovery_port = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.discovery_type = fw Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.initial_cmdsn = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.initial_login_retry_max = 8 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.xmit_thread_priority = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.cmds_max = 128 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.queue_depth = 32 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.nr_sessions = 1 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.auth.authmethod = CHAP Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.auth.username = t27GCDUif9ZHfCH3yDUn Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.auth.password = *** Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.auth.username_in = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.auth.password_in = Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.timeo.replacement_timeout = 120 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FastAbort = Yes Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.InitialR2T = No Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ImmediateData = Yes Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxConnections = 1 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ERL = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.scan = manual Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.reopen_max = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.session.conn_reopen_log_freq = 1 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.conn[0].address = 38.102.83.18 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.conn[0].port = 3260 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.conn[0].startup = manual Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.window_size = 524288 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.DataDigest = None Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.IFMarker = No Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.OFMarker = No Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: # END RECORD Jan 26 19:22:47.654816 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:22:47.658231 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:47.672672 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:47.673022 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6321328-f71e-4e1f-8389-2abce0650a47]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:47.673322 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:22:47.676205 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:47.685084 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:47.685480 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc327d5c-69c2-4604-a18b-ebdb2fdaf008]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:47.685689 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:22:47.686379 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.username -v t27GCDUif9ZHfCH3yDUn {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:47.695577 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.username -v t27GCDUif9ZHfCH3yDUn" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:47.695830 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f5e9a5-efda-402a-aa89-689522a77afd]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:47.696230 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 't27GCDUif9ZHfCH3yDUn'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:22:47.697023 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:47.708037 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:47.708142 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7809aa-509a-4928-b4b4-8ee0690f62b2]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:47.708458 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:22:47.709018 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:47.721937 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:47.722044 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[515565d0-a025-4867-8cc7-dce29febf331]: (4, ('tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash)\ntcp: [30] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:47.722275 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:22:47.722275 np0005596550.novalocal nova-compute[189076]: tcp: [30] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe (non-flash) Jan 26 19:22:47.722275 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:22:47.722416 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsi session list stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:22:47.722416 np0005596550.novalocal nova-compute[189076]: tcp: [30] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe (non-flash) Jan 26 19:22:47.722416 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:22:47.722995 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.080s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:22:47.723188 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connected to 38.102.83.18:3260 {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:22:47.723576 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] HCTL ('3', '0', '0', 0) found on session 30 with lun 0 {{(pid=189076) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:22:47.723707 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Scanning host 3 c: 0, t: 0, l: 0) {{(pid=189076) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:22:47.724331 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host3/scan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:22:47.732027 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host3/scan" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:22:47.732172 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[1188b072-b7c1-4dce-8c02-17f3eedac601]: (4, ('0 0 0', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:22:47.732486 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching for a device in session 30 and hctl ('3', '0', '0', 0) yield: sdb {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:22:47.733198 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connected to sdb using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe', 'target_lun': 0, 'volume_id': 'd13d5015-aabd-4db2-9327-ec66ee53bafe', 'auth_method': 'CHAP', 'auth_username': 't27GCDUif9ZHfCH3yDUn', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True} {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:22:47.733618 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.104s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:22:47.733783 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] <== connect_volume: return (104ms) {'type': 'block', 'scsi_wwn': '3600140528028ae1b6c44b1bbb2023c5c', 'path': '/dev/sdb'} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:22:47.733973 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3600140528028ae1b6c44b1bbb2023c5c', 'path': '/dev/sdb'} {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jan 26 19:22:47.738409 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'flavor' on Instance uuid 03068296-12d4-4dbe-9770-c070e336a3bf {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:22:48.245254 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] attach device xml: Jan 26 19:22:48.245254 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:48.245254 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:48.245254 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:48.245254 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:48.245254 np0005596550.novalocal nova-compute[189076]: d13d5015-aabd-4db2-9327-ec66ee53bafe Jan 26 19:22:48.245254 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:48.245254 np0005596550.novalocal nova-compute[189076]: Jan 26 19:22:48.245254 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:330}} Jan 26 19:22:48.450326 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:49.871724 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:22:49.874791 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:22:49.874791 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:22:49.874791 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No VIF found with MAC fa:16:3e:64:65:1e, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:22:51.101949 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:51.447000 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ee6eabcf-e96e-47c0-903c-b89f763e805c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "03068296-12d4-4dbe-9770-c070e336a3bf" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.991s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:22:52.957798 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Stashing vm_state: active {{(pid=189076) _prep_resize /opt/stack/nova/nova/compute/manager.py:6217}} Jan 26 19:22:53.450709 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:53.491727 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:22:53.492062 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:22:54.002119 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:22:54.002708 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Claim successful on node np0005596550.novalocal Jan 26 19:22:54.514977 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.resource_tracker [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Updating resource usage from migration ce7d667a-ea9e-4ad7-afbd-4df50f348400 Jan 26 19:22:54.788557 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:22:55.293377 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:22:55.802976 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.310s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:22:55.803480 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Migrating Jan 26 19:22:56.110689 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:56.338170 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:22:56.338592 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquired lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:22:56.338592 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:22:56.842224 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:22:57.086667 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:22:57.213409 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Updating instance_info_cache with network_info: [{"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:22:57.716733 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Releasing lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:22:59.237852 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Starting migrate_disk_and_power_off {{(pid=189076) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12481}} Jan 26 19:22:59.263821 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:59.379546 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e948b84a-27a9-4706-bf39-a2946074b848 req-573b43a3-eee0-4565-8f7f-363bc393f544 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Received event network-vif-unplugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:22:59.379662 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e948b84a-27a9-4706-bf39-a2946074b848 req-573b43a3-eee0-4565-8f7f-363bc393f544 service nova] Acquiring lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:22:59.379853 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e948b84a-27a9-4706-bf39-a2946074b848 req-573b43a3-eee0-4565-8f7f-363bc393f544 service nova] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:22:59.380011 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e948b84a-27a9-4706-bf39-a2946074b848 req-573b43a3-eee0-4565-8f7f-363bc393f544 service nova] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:22:59.380183 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e948b84a-27a9-4706-bf39-a2946074b848 req-573b43a3-eee0-4565-8f7f-363bc393f544 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] No waiting events found dispatching network-vif-unplugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:22:59.380333 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-e948b84a-27a9-4706-bf39-a2946074b848 req-573b43a3-eee0-4565-8f7f-363bc393f544 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Received unexpected event network-vif-unplugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f for instance with vm_state active and task_state resize_migrating. Jan 26 19:22:59.383099 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:59.388479 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:59.530309 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Instance destroyed successfully. Jan 26 19:22:59.531492 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:21:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='multiattach-server-0',id=104,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2DqNsC6gMM/rMUhFP33wutEbCJfSUZoLXi4knAQI7cL83VCjf4w8Ol5UVNVyCMMM4G5N6GoZa1daASRvj6YYLKi4Cz6e/HnHlp1PtG4CCeiOBWtfpou2xsaXI9ivoyQw==',key_name='tempest-keypair-1141931557',keypairs=,launch_index=0,launched_at=2026-01-27T00:22:08Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-1796nvkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:22:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=7985cac9-68f6-40e7-bb90-7761b4220db7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "vif_mac": "fa:16:3e:9a:38:7d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:22:59.531710 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "vif_mac": "fa:16:3e:9a:38:7d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:22:59.532473 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:38:7d,bridge_name='br-int',has_traffic_filtering=True,id=2a61c5d0-be1d-4c00-9d7b-8854ff697d7f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a61c5d0-be') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:22:59.532970 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:38:7d,bridge_name='br-int',has_traffic_filtering=True,id=2a61c5d0-be1d-4c00-9d7b-8854ff697d7f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a61c5d0-be') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:22:59.534431 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:59.534865 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a61c5d0-be, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:22:59.536044 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:59.540387 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:59.542574 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:59.543112 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3f70b27-98df-4ac9-9401-dd70273236a0) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:22:59.544356 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:22:59.547485 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:22:59.550261 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:38:7d,bridge_name='br-int',has_traffic_filtering=True,id=2a61c5d0-be1d-4c00-9d7b-8854ff697d7f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a61c5d0-be') Jan 26 19:23:00.090222 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Detected multiple connections on this host for volume: d13d5015-aabd-4db2-9327-ec66ee53bafe, skipping target disconnect. Jan 26 19:23:00.093654 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:00.160061 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk --force-share --output=json" returned: 0 in 0.066s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:00.160413 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:00.247475 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:00.248117 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=189076) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12209}} Jan 26 19:23:00.248419 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7_resize/disk /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:00.283072 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "cp -r /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7_resize/disk /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk" returned: 0 in 0.034s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:00.283284 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7_resize/disk.config /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk.config {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:00.300684 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "cp -r /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7_resize/disk.config /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk.config" returned: 0 in 0.017s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:00.300946 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7_resize/disk.info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk.info {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:00.314097 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "cp -r /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7_resize/disk.info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk.info" returned: 0 in 0.013s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:01.414684 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-cf717b72-77e1-487b-85c5-c870a67dc871 req-6d51ce8c-c878-42a2-b469-beedda90ef98 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Received event network-vif-unplugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:23:01.415165 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-cf717b72-77e1-487b-85c5-c870a67dc871 req-6d51ce8c-c878-42a2-b469-beedda90ef98 service nova] Acquiring lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:23:01.415730 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-cf717b72-77e1-487b-85c5-c870a67dc871 req-6d51ce8c-c878-42a2-b469-beedda90ef98 service nova] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:23:01.416165 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-cf717b72-77e1-487b-85c5-c870a67dc871 req-6d51ce8c-c878-42a2-b469-beedda90ef98 service nova] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:23:01.416491 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-cf717b72-77e1-487b-85c5-c870a67dc871 req-6d51ce8c-c878-42a2-b469-beedda90ef98 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] No waiting events found dispatching network-vif-unplugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:23:01.416914 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-cf717b72-77e1-487b-85c5-c870a67dc871 req-6d51ce8c-c878-42a2-b469-beedda90ef98 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Received unexpected event network-vif-unplugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f for instance with vm_state active and task_state resize_migrating. Jan 26 19:23:01.437445 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:23:01.437928 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:23:01.520383 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Port 2a61c5d0-be1d-4c00-9d7b-8854ff697d7f binding to destination host np0005596550.novalocal is already ACTIVE {{(pid=189076) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jan 26 19:23:02.543501 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:23:02.543941 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:23:02.543941 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:23:03.548735 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:23:03.596121 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:23:03.596296 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquired lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:23:03.596506 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:23:04.099955 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:23:04.320336 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:23:04.426063 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Updating instance_info_cache with network_info: [{"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:23:04.544144 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:04.929889 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Releasing lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:23:05.441428 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': True, 'host': 'np0005596550.novalocal', 'execute': None}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:23:05.442530 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:05.448601 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.006s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:05.448753 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e20af71-0abf-4c44-b6d3-6692ca019709]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:05.450264 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[ceb456a2-0e47-422b-8646-76b2e7389942]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:23:05.450264 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:23:05.450264 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:23:05.450264 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:23:05.450264 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:23:05.450264 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:23:05.450264 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:23:05.450264 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:23:05.450264 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:23:05.450264 np0005596550.novalocal nova-compute[189076]: with open_scini_device() as fd: Jan 26 19:23:05.450264 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:23:05.450264 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:23:05.450264 np0005596550.novalocal nova-compute[189076]: return next(self.gen) Jan 26 19:23:05.450264 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^ Jan 26 19:23:05.450264 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:23:05.450264 np0005596550.novalocal nova-compute[189076]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:23:05.450264 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:23:05.450264 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:23:05.450741 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb456a2-0e47-422b-8646-76b2e7389942]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:05.451046 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.scaleio [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:23:05.451192 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.scaleio [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:23:05.451915 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:05.458942 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:05.459084 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a3bf5e-607e-4ca7-8e45-7c2a5e7704f3]: (4, ('/dev/vda2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:05.460369 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:05.467851 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:05.468015 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[285603f4-5432-48b2-903d-60a7759ad96b]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:05.468930 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d631fa7-5ecc-4614-b906-93401b120bcd]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:05.469240 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): nvme version {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:05.484308 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] 'nvme version' failed. Not Retrying. {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:23:05.484564 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] nvme not present on system {{(pid=189076) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:23:05.486097 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=189076) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:23:05.486856 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.lightos [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fec2:720d', 'fe80::f4ec:16ff:fe16:3ba5', 'fe80::fc16:3eff:fe6b:2533', 'fe80::fc16:3eff:fe8b:6175', 'fe80::fc16:3eff:fe64:651e'] Jan 26 19:23:05.486972 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:23:05.487125 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:23:05.487379 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] <== get_connector_properties: return (45ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': True, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fec2:720d', 'fe80::f4ec:16ff:fe16:3ba5', 'fe80::fc16:3eff:fe6b:2533', 'fe80::fc16:3eff:fe8b:6175', 'fe80::fc16:3eff:fe64:651e']} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:23:09.573077 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:23:09.573077 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:23:09.573077 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:23:09.573077 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:23:09.574531 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:09.574843 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:23:10.128086 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Starting finish_migration {{(pid=189076) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12668}} Jan 26 19:23:10.129520 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Instance directory exists: not creating {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5157}} Jan 26 19:23:10.129715 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Creating image(s) Jan 26 19:23:10.131011 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:10.224645 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.093s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:10.225069 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:23:10.225359 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:10.319687 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:10.320106 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Cannot resize image /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:23:10.824987 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Did not create local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5295}} Jan 26 19:23:10.825443 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Ensure instance console log exists: /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:23:10.826093 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:23:10.826537 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:23:10.826909 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:23:10.839515 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Start _get_guest_xml network_info=[{"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "vif_mac": "fa:16:3e:9a:38:7d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '7f6a0586-f7cd-457e-83e1-009370ee571d', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe', 'target_lun': 0, 'volume_id': 'd13d5015-aabd-4db2-9327-ec66ee53bafe', 'auth_method': 'CHAP', 'auth_username': 't27GCDUif9ZHfCH3yDUn', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '7985cac9-68f6-40e7-bb90-7761b4220db7', 'attached_at': '2026-01-27T00:23:08.000000', 'detached_at': '', 'volume_id': 'd13d5015-aabd-4db2-9327-ec66ee53bafe', 'multiattach': True, 'serial': 'd13d5015-aabd-4db2-9327-ec66ee53bafe'}, 'boot_index': None, 'device_type': 'disk', 'volume_type': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:23:10.844945 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:23:10.846820 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='7985cac9-68f6-40e7-bb90-7761b4220db7'), owner=OwnerMeta(userid='d2494a2c41134b13a25b86d1bdfdd65f', username='tempest-AttachVolumeMultiAttachTest-1495503700-project-member', projectid='4a07dd99b19249acb501695a25608424', projectname='tempest-AttachVolumeMultiAttachTest-1495503700'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "vif_mac": "fa:16:3e:9a:38:7d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769473390.846199) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:23:10.848989 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:23:10.849684 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:23:10.851328 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:23:10.851893 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:23:10.853304 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:23:10.853941 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:23:10.854272 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:23:10.854529 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:23:10.854845 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:23:10.855194 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:23:10.855345 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:23:10.855714 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:23:10.856147 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:23:10.856542 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:23:10.856854 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:23:10.857148 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:23:10.862111 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk.config --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:10.949276 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk.config --force-share --output=json" returned: 0 in 0.087s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:10.949612 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "/opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:23:10.949862 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "/opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:23:10.950392 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "/opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:23:10.950697 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Calling os-brick to attach iSCSI Volume {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jan 26 19:23:10.951322 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe', 'target_lun': 0, 'volume_id': 'd13d5015-aabd-4db2-9327-ec66ee53bafe', 'auth_method': 'CHAP', 'auth_username': 't27GCDUif9ZHfCH3yDUn', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:23:10.951473 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:23:10.951796 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:23:10.951955 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe', 'target_lun': 0, 'volume_id': 'd13d5015-aabd-4db2-9327-ec66ee53bafe', 'auth_method': 'CHAP', 'auth_username': 't27GCDUif9ZHfCH3yDUn', 'auth_password': '8wKKK5H2F7ThGsAY', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True} {{(pid=189076) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:23:10.952946 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:10.958782 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:23:10.961095 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[602f00b5-6411-49ed-a568-0ec06d95e753]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:23:10.961095 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:23:10.961095 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:23:10.961095 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:23:10.961095 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:23:10.961095 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:23:10.961095 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:23:10.961095 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:23:10.961095 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:23:10.961095 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:23:10.961095 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:23:10.961095 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:23:10.961095 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:23:10.961095 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:23:10.961095 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:23:10.961095 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:23:10.961095 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:23:10.961095 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:23:10.961095 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:23:10.961095 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:23:10.961095 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:23:10.961095 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:23:10.963071 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[602f00b5-6411-49ed-a568-0ec06d95e753]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:10.963876 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:23:10.964396 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:23:10.964815 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:23:10.965758 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:10.975573 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:10.975940 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[372a817f-d327-45cf-82b4-45709f5876c7]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = t27GCDUif9ZHfCH3yDUn\nnode.session.auth.password = ********\nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.name = iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.tpgt = -1 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.startup = automatic Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.leading_login = No Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.iscsi_ifacename = default Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.net_ifacename = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.ipaddress = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.prefix_len = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.hwaddress = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.transport_name = tcp Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.initiatorname = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.state = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.vlan_id = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.vlan_priority = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.vlan_state = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.iface_num = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.mtu = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.port = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.bootproto = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.subnet_mask = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.gateway = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id_state = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.dhcp_dns = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.dhcp_learn_iqn = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.dhcp_req_vendor_id_state = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id_state = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.dhcp_slp_da = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.fragmentation = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.gratuitous_arp = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.incoming_forwarding = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.tos_state = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.tos = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.ttl = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.delayed_ack = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.tcp_nagle = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf_state = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.tcp_timer_scale = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.tcp_timestamp = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.redirect = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.def_task_mgmt_timeout = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.header_digest = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.data_digest = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.immediate_data = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.initial_r2t = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.data_seq_inorder = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.data_pdu_inorder = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.erl = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.max_receive_data_len = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.first_burst_len = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.max_outstanding_r2t = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.max_burst_len = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.chap_auth = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.bidi_chap = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.strict_login_compliance = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.discovery_auth = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: iface.discovery_logout = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.discovery_address = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.discovery_port = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.discovery_type = fw Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.initial_cmdsn = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.initial_login_retry_max = 8 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.xmit_thread_priority = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.cmds_max = 128 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.queue_depth = 32 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.nr_sessions = 1 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.auth.authmethod = CHAP Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.auth.username = t27GCDUif9ZHfCH3yDUn Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.auth.password = *** Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.auth.username_in = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.auth.password_in = Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.timeo.replacement_timeout = 120 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FastAbort = Yes Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.InitialR2T = No Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ImmediateData = Yes Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxConnections = 1 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ERL = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.scan = manual Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.reopen_max = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.session.conn_reopen_log_freq = 1 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.conn[0].address = 38.102.83.18 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.conn[0].port = 3260 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.conn[0].startup = manual Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.window_size = 524288 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.DataDigest = None Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.IFMarker = No Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.OFMarker = No Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: # END RECORD Jan 26 19:23:10.977191 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:23:10.980086 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:10.988925 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:10.989464 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e305a7-b8d0-45ab-a799-278497c7c2aa]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:10.989990 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:23:10.990966 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:11.001145 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:11.001317 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7189ad7-0868-4304-9612-6e59b8976c99]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:11.001715 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:23:11.002577 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.username -v t27GCDUif9ZHfCH3yDUn {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:11.011841 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.username -v t27GCDUif9ZHfCH3yDUn" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:11.012038 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddab62c-93a7-4da3-a7ea-e72bce99a8dc]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:11.012330 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 't27GCDUif9ZHfCH3yDUn'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:23:11.013381 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:11.022827 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:11.023206 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a781c9ca-3ec6-4efe-9870-c177b3c63925]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:11.023679 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:23:11.026811 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:11.035284 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:11.035847 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78ad24b-d279-4dd1-ac9e-1e1c1058b89b]: (4, ('tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash)\ntcp: [30] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:11.036252 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:23:11.036252 np0005596550.novalocal nova-compute[189076]: tcp: [30] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe (non-flash) Jan 26 19:23:11.036252 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:23:11.036529 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsi session list stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:23:11.036529 np0005596550.novalocal nova-compute[189076]: tcp: [30] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe (non-flash) Jan 26 19:23:11.036529 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:23:11.037007 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.073s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:23:11.037321 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connected to 38.102.83.18:3260 {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:23:11.038378 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] HCTL ('3', '0', '0', 0) found on session 30 with lun 0 {{(pid=189076) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:23:11.038378 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Scanning host 3 c: 0, t: 0, l: 0) {{(pid=189076) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:23:11.039258 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host3/scan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:11.050785 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host3/scan" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:11.050785 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[485eaa5e-0a37-4a9d-b454-ff784eaa797c]: (4, ('0 0 0', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:11.051503 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching for a device in session 30 and hctl ('3', '0', '0', 0) yield: sdb {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:23:11.052499 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connected to sdb using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe', 'target_lun': 0, 'volume_id': 'd13d5015-aabd-4db2-9327-ec66ee53bafe', 'auth_method': 'CHAP', 'auth_username': 't27GCDUif9ZHfCH3yDUn', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True} {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:23:11.053388 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.101s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:23:11.053811 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] <== connect_volume: return (101ms) {'type': 'block', 'scsi_wwn': '3600140528028ae1b6c44b1bbb2023c5c', 'path': '/dev/sdb'} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:23:11.054218 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3600140528028ae1b6c44b1bbb2023c5c', 'path': '/dev/sdb'} {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jan 26 19:23:11.567013 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:21:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='multiattach-server-0',id=104,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2DqNsC6gMM/rMUhFP33wutEbCJfSUZoLXi4knAQI7cL83VCjf4w8Ol5UVNVyCMMM4G5N6GoZa1daASRvj6YYLKi4Cz6e/HnHlp1PtG4CCeiOBWtfpou2xsaXI9ivoyQw==',key_name='tempest-keypair-1141931557',keypairs=,launch_index=0,launched_at=2026-01-27T00:22:08Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-1796nvkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=7985cac9-68f6-40e7-bb90-7761b4220db7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "vif_mac": "fa:16:3e:9a:38:7d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:23:11.567293 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "vif_mac": "fa:16:3e:9a:38:7d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:23:11.567900 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:38:7d,bridge_name='br-int',has_traffic_filtering=True,id=2a61c5d0-be1d-4c00-9d7b-8854ff697d7f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a61c5d0-be') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] End _get_guest_xml xml= Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: 7985cac9-68f6-40e7-bb90-7761b4220db7 Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: instance-00000068 Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: 262144 Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: multiattach-server-0 Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:23:10 Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: 256 Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: ide Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: pc Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: tempest-AttachVolumeMultiAttachTest-1495503700-project-member Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: tempest-AttachVolumeMultiAttachTest-1495503700 Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: 7985cac9-68f6-40e7-bb90-7761b4220db7 Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: 7985cac9-68f6-40e7-bb90-7761b4220db7 Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: d13d5015-aabd-4db2-9327-ec66ee53bafe Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:11.569530 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:23:11.571861 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:21:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='multiattach-server-0',id=104,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2DqNsC6gMM/rMUhFP33wutEbCJfSUZoLXi4knAQI7cL83VCjf4w8Ol5UVNVyCMMM4G5N6GoZa1daASRvj6YYLKi4Cz6e/HnHlp1PtG4CCeiOBWtfpou2xsaXI9ivoyQw==',key_name='tempest-keypair-1141931557',keypairs=,launch_index=0,launched_at=2026-01-27T00:22:08Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-1796nvkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=7985cac9-68f6-40e7-bb90-7761b4220db7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "vif_mac": "fa:16:3e:9a:38:7d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:23:11.571861 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "vif_mac": "fa:16:3e:9a:38:7d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:23:11.572064 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:38:7d,bridge_name='br-int',has_traffic_filtering=True,id=2a61c5d0-be1d-4c00-9d7b-8854ff697d7f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a61c5d0-be') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:23:11.572064 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:38:7d,bridge_name='br-int',has_traffic_filtering=True,id=2a61c5d0-be1d-4c00-9d7b-8854ff697d7f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a61c5d0-be') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:23:11.572064 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:11.572341 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:23:11.572614 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:23:11.573293 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:11.573503 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b259db68-3c12-55f2-a273-7424d731a9e5', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:23:11.574449 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:11.576126 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:11.578143 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:11.578315 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a61c5d0-be, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:23:11.578598 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a61c5d0-be, col_values=(('qos', UUID('eb8a2a06-d775-4f4e-bdaa-cbc046d5d635')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:23:11.578760 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a61c5d0-be, col_values=(('external_ids', {'iface-id': '2a61c5d0-be1d-4c00-9d7b-8854ff697d7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:38:7d', 'vm-uuid': '7985cac9-68f6-40e7-bb90-7761b4220db7'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:23:11.580044 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:11.582574 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:23:11.590047 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:11.591198 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:38:7d,bridge_name='br-int',has_traffic_filtering=True,id=2a61c5d0-be1d-4c00-9d7b-8854ff697d7f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a61c5d0-be') Jan 26 19:23:13.130492 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:23:13.130922 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:23:13.130922 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:23:13.131062 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No VIF found with MAC fa:16:3e:9a:38:7d, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:23:13.131762 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Using config drive Jan 26 19:23:13.197174 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:13.205980 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:13.327960 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:13.329524 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:13.456392 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:13.484872 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for 7985cac9-68f6-40e7-bb90-7761b4220db7 due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:23:13.486632 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:23:13.486816 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] VM Resumed (Lifecycle Event) Jan 26 19:23:13.492090 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Instance event wait completed in 0 seconds for {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:23:13.493512 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-2ac98433-c6db-4a82-b167-f17b8c8e07c4 req-67cc1b0c-4774-4721-9557-a5c69c40e332 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Received event network-vif-plugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:23:13.493708 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2ac98433-c6db-4a82-b167-f17b8c8e07c4 req-67cc1b0c-4774-4721-9557-a5c69c40e332 service nova] Acquiring lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:23:13.495383 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2ac98433-c6db-4a82-b167-f17b8c8e07c4 req-67cc1b0c-4774-4721-9557-a5c69c40e332 service nova] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:23:13.495383 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2ac98433-c6db-4a82-b167-f17b8c8e07c4 req-67cc1b0c-4774-4721-9557-a5c69c40e332 service nova] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:23:13.495383 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-2ac98433-c6db-4a82-b167-f17b8c8e07c4 req-67cc1b0c-4774-4721-9557-a5c69c40e332 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] No waiting events found dispatching network-vif-plugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:23:13.495383 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-2ac98433-c6db-4a82-b167-f17b8c8e07c4 req-67cc1b0c-4774-4721-9557-a5c69c40e332 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Received unexpected event network-vif-plugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f for instance with vm_state active and task_state resize_finish. Jan 26 19:23:13.499009 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Instance running successfully. Jan 26 19:23:13.500266 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Failed to set time: agent not configured {{(pid=189076) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}} Jan 26 19:23:13.500426 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-c15950db-8d87-46c8-b642-ea992fabfa5c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] finish_migration finished successfully. {{(pid=189076) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12763}} Jan 26 19:23:13.740077 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:13.996447 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:23:14.000904 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:23:14.504336 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] During sync_power_state the instance has a pending task (resize_finish). Skip. Jan 26 19:23:14.504717 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:23:14.504872 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] VM Started (Lifecycle Event) Jan 26 19:23:15.008640 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:23:15.011399 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:23:15.478848 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2ba0dee8-8141-4b31-9b58-6c3898120b5a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "7985cac9-68f6-40e7-bb90-7761b4220db7" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:23:15.478970 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2ba0dee8-8141-4b31-9b58-6c3898120b5a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7" acquired by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:23:15.479154 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-2ba0dee8-8141-4b31-9b58-6c3898120b5a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Going to confirm migration 9 {{(pid=189076) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5331}} Jan 26 19:23:15.527720 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-9152a447-4a16-4fc4-9883-ab458db1d69e req-f0959fba-a42b-491e-b84b-6694e2d4cd6f service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Received event network-vif-plugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:23:15.528564 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-9152a447-4a16-4fc4-9883-ab458db1d69e req-f0959fba-a42b-491e-b84b-6694e2d4cd6f service nova] Acquiring lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:23:15.528564 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-9152a447-4a16-4fc4-9883-ab458db1d69e req-f0959fba-a42b-491e-b84b-6694e2d4cd6f service nova] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:23:15.528564 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-9152a447-4a16-4fc4-9883-ab458db1d69e req-f0959fba-a42b-491e-b84b-6694e2d4cd6f service nova] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:23:15.528564 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-9152a447-4a16-4fc4-9883-ab458db1d69e req-f0959fba-a42b-491e-b84b-6694e2d4cd6f service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] No waiting events found dispatching network-vif-plugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:23:15.528868 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-9152a447-4a16-4fc4-9883-ab458db1d69e req-f0959fba-a42b-491e-b84b-6694e2d4cd6f service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Received unexpected event network-vif-plugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f for instance with vm_state resized and task_state None. Jan 26 19:23:15.984608 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-2ba0dee8-8141-4b31-9b58-6c3898120b5a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:23:16.043209 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-2ba0dee8-8141-4b31-9b58-6c3898120b5a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:23:16.043857 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2ba0dee8-8141-4b31-9b58-6c3898120b5a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:23:16.044196 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2ba0dee8-8141-4b31-9b58-6c3898120b5a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquired lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:23:16.044626 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-2ba0dee8-8141-4b31-9b58-6c3898120b5a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:23:16.045176 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-2ba0dee8-8141-4b31-9b58-6c3898120b5a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'info_cache' on Instance uuid 7985cac9-68f6-40e7-bb90-7761b4220db7 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:23:16.621552 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:17.056578 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-2ba0dee8-8141-4b31-9b58-6c3898120b5a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:23:17.299107 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-2ba0dee8-8141-4b31-9b58-6c3898120b5a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:23:17.385198 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-2ba0dee8-8141-4b31-9b58-6c3898120b5a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Updating instance_info_cache with network_info: [{"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:23:17.888666 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2ba0dee8-8141-4b31-9b58-6c3898120b5a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Releasing lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:23:17.889130 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-2ba0dee8-8141-4b31-9b58-6c3898120b5a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'migration_context' on Instance uuid 7985cac9-68f6-40e7-bb90-7761b4220db7 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:23:18.393014 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-2ba0dee8-8141-4b31-9b58-6c3898120b5a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Object Instance<7985cac9-68f6-40e7-bb90-7761b4220db7> lazy-loaded attributes: info_cache,migration_context {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:23:18.394299 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2ba0dee8-8141-4b31-9b58-6c3898120b5a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:23:18.394581 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2ba0dee8-8141-4b31-9b58-6c3898120b5a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:23:19.110064 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-2ba0dee8-8141-4b31-9b58-6c3898120b5a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:23:19.616223 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-2ba0dee8-8141-4b31-9b58-6c3898120b5a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:23:20.632531 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2ba0dee8-8141-4b31-9b58-6c3898120b5a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.238s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:23:21.338718 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-2ba0dee8-8141-4b31-9b58-6c3898120b5a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Deleted allocation for migration ce7d667a-ea9e-4ad7-afbd-4df50f348400 Jan 26 19:23:21.622795 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:21.849355 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-2ba0dee8-8141-4b31-9b58-6c3898120b5a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7" "released" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: held 6.370s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:23:22.270834 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-dd1f684e-a636-457e-adf7-940391a68cae req-764fa270-3542-4948-b056-3fab631587da service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Received event network-changed-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:23:22.271022 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-dd1f684e-a636-457e-adf7-940391a68cae req-764fa270-3542-4948-b056-3fab631587da service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Refreshing instance network info cache due to event network-changed-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:23:22.271224 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-dd1f684e-a636-457e-adf7-940391a68cae req-764fa270-3542-4948-b056-3fab631587da service nova] Acquiring lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:23:22.271374 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-dd1f684e-a636-457e-adf7-940391a68cae req-764fa270-3542-4948-b056-3fab631587da service nova] Acquired lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:23:22.271537 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-dd1f684e-a636-457e-adf7-940391a68cae req-764fa270-3542-4948-b056-3fab631587da service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Refreshing network info cache for port c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:23:22.774516 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-dd1f684e-a636-457e-adf7-940391a68cae req-764fa270-3542-4948-b056-3fab631587da service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:23:23.178187 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-dd1f684e-a636-457e-adf7-940391a68cae req-764fa270-3542-4948-b056-3fab631587da service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:23:23.327379 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-dd1f684e-a636-457e-adf7-940391a68cae req-764fa270-3542-4948-b056-3fab631587da service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Updated VIF entry in instance network info cache for port c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:23:23.327648 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-dd1f684e-a636-457e-adf7-940391a68cae req-764fa270-3542-4948-b056-3fab631587da service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Updating instance_info_cache with network_info: [{"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:23:23.458988 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:23.883484 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-dd1f684e-a636-457e-adf7-940391a68cae req-764fa270-3542-4948-b056-3fab631587da service nova] Releasing lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:23:24.307462 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e648a9da-1379-4c81-ae85-709c38572f95 req-35953d8c-d527-45c8-896f-c5a888515835 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Received event network-changed-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:23:24.308063 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e648a9da-1379-4c81-ae85-709c38572f95 req-35953d8c-d527-45c8-896f-c5a888515835 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Refreshing instance network info cache due to event network-changed-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:23:24.308063 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e648a9da-1379-4c81-ae85-709c38572f95 req-35953d8c-d527-45c8-896f-c5a888515835 service nova] Acquiring lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:23:24.308063 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e648a9da-1379-4c81-ae85-709c38572f95 req-35953d8c-d527-45c8-896f-c5a888515835 service nova] Acquired lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:23:24.308239 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-e648a9da-1379-4c81-ae85-709c38572f95 req-35953d8c-d527-45c8-896f-c5a888515835 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Refreshing network info cache for port 2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:23:24.811144 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-e648a9da-1379-4c81-ae85-709c38572f95 req-35953d8c-d527-45c8-896f-c5a888515835 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:23:25.037986 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-e648a9da-1379-4c81-ae85-709c38572f95 req-35953d8c-d527-45c8-896f-c5a888515835 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:23:25.141481 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-e648a9da-1379-4c81-ae85-709c38572f95 req-35953d8c-d527-45c8-896f-c5a888515835 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Updated VIF entry in instance network info cache for port 2a61c5d0-be1d-4c00-9d7b-8854ff697d7f. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:23:25.142441 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-e648a9da-1379-4c81-ae85-709c38572f95 req-35953d8c-d527-45c8-896f-c5a888515835 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Updating instance_info_cache with network_info: [{"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:23:25.648670 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e648a9da-1379-4c81-ae85-709c38572f95 req-35953d8c-d527-45c8-896f-c5a888515835 service nova] Releasing lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:23:25.897134 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:23:26.625280 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:28.460732 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:29.896334 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:23:30.403467 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:23:30.403822 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:23:30.404128 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:23:30.404402 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:23:31.444717 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:31.511045 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk --force-share --output=json" returned: 0 in 0.066s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:31.511399 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:31.599203 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:31.599862 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=189076) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12209}} Jan 26 19:23:31.606950 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:31.628556 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:31.681745 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:31.682171 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:31.745467 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk --force-share --output=json" returned: 0 in 0.063s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:31.748971 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:31.824038 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:31.824436 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:31.902281 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:31.909312 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] skipping disk /dev/sda (vda) as it is a volume {{(pid=189076) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12209}} Jan 26 19:23:31.914363 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:31.980967 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk --force-share --output=json" returned: 0 in 0.066s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:31.981612 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:32.051093 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk --force-share --output=json" returned: 0 in 0.069s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:32.051438 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=189076) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12209}} Jan 26 19:23:32.137970 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:23:32.138991 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:32.155433 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.016s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:32.155734 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=6507MB free_disk=371.6852226257324GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:23:32.155944 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:23:32.156253 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:23:33.230250 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance a7010931-641e-45d6-a8df-edd43c91ae9b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:23:33.230786 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance dbcbca53-6fab-4827-b3dc-a25e7eb6bb70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:23:33.230868 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 28db8142-2f27-4207-923f-f2f525867805 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:23:33.231107 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 03068296-12d4-4dbe-9770-c070e336a3bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:23:33.231327 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 7985cac9-68f6-40e7-bb90-7761b4220db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:23:33.231644 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 5 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:23:33.232158 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=1536MB phys_disk=399GB used_disk=4GB total_vcpus=8 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:23:32 up 51 min, 13 users, load average: 2.29, 3.39, 3.89\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '5', 'num_proj_4a07dd99b19249acb501695a25608424': '5', 'io_workload': '0'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:23:33.412400 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:23:33.463157 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:33.915404 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:23:34.421188 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:23:34.421735 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.265s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:23:36.423508 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:23:36.423508 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:23:36.423508 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:23:36.630858 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:36.895854 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:23:37.803814 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Stashing vm_state: active {{(pid=189076) _prep_resize /opt/stack/nova/nova/compute/manager.py:6217}} Jan 26 19:23:38.356804 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:23:38.357138 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:23:38.465900 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:38.869867 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:23:38.870713 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Claim successful on node np0005596550.novalocal Jan 26 19:23:39.381551 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.resource_tracker [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Updating resource usage from migration 4cb998a1-3677-40ee-9baf-6587382af831 Jan 26 19:23:39.672903 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:23:39.891595 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:23:40.175978 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:23:40.681888 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.325s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:23:40.682039 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Migrating Jan 26 19:23:40.894994 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:23:40.895736 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:23:41.194464 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:23:41.194609 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquired lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:23:41.194802 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:23:41.633206 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:41.698860 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:23:42.033858 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:23:42.175345 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Updating instance_info_cache with network_info: [{"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:23:42.679591 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Releasing lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:23:43.473544 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:44.200367 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Starting migrate_disk_and_power_off {{(pid=189076) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12481}} Jan 26 19:23:44.232267 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:44.233841 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:44.237117 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:44.353504 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-93a652ff-a600-4d9a-a3b0-936295fe91f3 req-5b347c79-f06b-40df-a0d9-8df1c0338b58 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Received event network-vif-unplugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:23:44.353826 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-93a652ff-a600-4d9a-a3b0-936295fe91f3 req-5b347c79-f06b-40df-a0d9-8df1c0338b58 service nova] Acquiring lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:23:44.355806 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-93a652ff-a600-4d9a-a3b0-936295fe91f3 req-5b347c79-f06b-40df-a0d9-8df1c0338b58 service nova] Lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:23:44.355806 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-93a652ff-a600-4d9a-a3b0-936295fe91f3 req-5b347c79-f06b-40df-a0d9-8df1c0338b58 service nova] Lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:23:44.355806 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-93a652ff-a600-4d9a-a3b0-936295fe91f3 req-5b347c79-f06b-40df-a0d9-8df1c0338b58 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] No waiting events found dispatching network-vif-unplugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:23:44.355806 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-93a652ff-a600-4d9a-a3b0-936295fe91f3 req-5b347c79-f06b-40df-a0d9-8df1c0338b58 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Received unexpected event network-vif-unplugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f for instance with vm_state active and task_state resize_migrating. Jan 26 19:23:44.364332 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:44.368849 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:44.486986 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Instance destroyed successfully. Jan 26 19:23:44.486986 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:22:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='multiattach-server-1',id=105,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2DqNsC6gMM/rMUhFP33wutEbCJfSUZoLXi4knAQI7cL83VCjf4w8Ol5UVNVyCMMM4G5N6GoZa1daASRvj6YYLKi4Cz6e/HnHlp1PtG4CCeiOBWtfpou2xsaXI9ivoyQw==',key_name='tempest-keypair-1141931557',keypairs=,launch_index=0,launched_at=2026-01-27T00:22:24Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-yxpzl051',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:23:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=03068296-12d4-4dbe-9770-c070e336a3bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "vif_mac": "fa:16:3e:64:65:1e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:23:44.486986 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "vif_mac": "fa:16:3e:64:65:1e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:23:44.488237 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:65:1e,bridge_name='br-int',has_traffic_filtering=True,id=c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0932d0a-9e') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:23:44.488840 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:65:1e,bridge_name='br-int',has_traffic_filtering=True,id=c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0932d0a-9e') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:23:44.491280 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:44.492053 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0932d0a-9e, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:23:44.523236 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:44.524864 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:44.525567 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:44.525851 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a37e91f6-ffd1-4ca6-82c0-b4e396fa896e) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:23:44.526558 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:44.529144 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:44.531238 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:65:1e,bridge_name='br-int',has_traffic_filtering=True,id=c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0932d0a-9e') Jan 26 19:23:44.892140 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:23:45.074682 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Detected multiple connections on this host for volume: d13d5015-aabd-4db2-9327-ec66ee53bafe, skipping target disconnect. Jan 26 19:23:45.079419 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:45.153639 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk --force-share --output=json" returned: 0 in 0.074s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:45.154138 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:45.215851 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk --force-share --output=json" returned: 0 in 0.061s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:45.215851 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=189076) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12209}} Jan 26 19:23:45.216534 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf_resize/disk /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:45.238316 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "cp -r /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf_resize/disk /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk" returned: 0 in 0.022s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:45.238639 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf_resize/disk.config /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk.config {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:45.269713 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "cp -r /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf_resize/disk.config /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk.config" returned: 0 in 0.031s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:45.270268 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf_resize/disk.info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk.info {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:45.287017 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "cp -r /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf_resize/disk.info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk.info" returned: 0 in 0.016s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:46.393160 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d41c4c1c-b6fe-4f1d-a8dd-f5e3778e0860 req-5769ee62-8caf-4067-ac12-eb5fd616b7e7 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Received event network-vif-unplugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:23:46.393610 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d41c4c1c-b6fe-4f1d-a8dd-f5e3778e0860 req-5769ee62-8caf-4067-ac12-eb5fd616b7e7 service nova] Acquiring lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:23:46.394182 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d41c4c1c-b6fe-4f1d-a8dd-f5e3778e0860 req-5769ee62-8caf-4067-ac12-eb5fd616b7e7 service nova] Lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:23:46.394230 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d41c4c1c-b6fe-4f1d-a8dd-f5e3778e0860 req-5769ee62-8caf-4067-ac12-eb5fd616b7e7 service nova] Lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:23:46.394500 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d41c4c1c-b6fe-4f1d-a8dd-f5e3778e0860 req-5769ee62-8caf-4067-ac12-eb5fd616b7e7 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] No waiting events found dispatching network-vif-unplugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:23:46.394811 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-d41c4c1c-b6fe-4f1d-a8dd-f5e3778e0860 req-5769ee62-8caf-4067-ac12-eb5fd616b7e7 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Received unexpected event network-vif-unplugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f for instance with vm_state active and task_state resize_migrating. Jan 26 19:23:46.395635 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:23:46.396061 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:23:46.450294 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Port c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f binding to destination host np0005596550.novalocal is already ACTIVE {{(pid=189076) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jan 26 19:23:47.478477 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:23:47.479058 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:23:47.479058 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:23:48.486952 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:23:48.542526 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:23:48.542892 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquired lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:23:48.543213 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:23:49.046439 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:23:49.552259 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:49.753624 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:23:49.881564 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Updating instance_info_cache with network_info: [{"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:23:50.384581 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Releasing lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:23:50.895486 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': True, 'host': 'np0005596550.novalocal', 'execute': None}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:23:50.897679 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:50.904182 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.006s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:50.904310 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[038a5ed3-774d-4a44-b0da-b1ff3e3e9606]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:50.906937 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[f50a7d7e-05cc-47ba-836f-8065cd95c045]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:23:50.906937 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:23:50.906937 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:23:50.906937 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:23:50.906937 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:23:50.906937 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:23:50.906937 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:23:50.906937 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:23:50.906937 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:23:50.906937 np0005596550.novalocal nova-compute[189076]: with open_scini_device() as fd: Jan 26 19:23:50.906937 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:23:50.906937 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:23:50.906937 np0005596550.novalocal nova-compute[189076]: return next(self.gen) Jan 26 19:23:50.906937 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^ Jan 26 19:23:50.906937 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:23:50.906937 np0005596550.novalocal nova-compute[189076]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:23:50.906937 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:23:50.906937 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:23:50.907791 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50a7d7e-05cc-47ba-836f-8065cd95c045]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:50.908192 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.scaleio [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:23:50.908392 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.scaleio [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:23:50.909329 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:50.922662 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:50.922934 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76de6f6-5d03-4410-8d87-2e98aa7d8000]: (4, ('/dev/vda2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:50.923915 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:50.938677 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.014s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:50.939145 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d16e0c-3ce0-4e19-9aaa-2f822f318c12]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:50.940295 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8d9e33-2e00-48e6-ae5f-4c359fcbf616]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:50.940592 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): nvme version {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:50.960218 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] 'nvme version' failed. Not Retrying. {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:23:50.960477 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] nvme not present on system {{(pid=189076) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:23:50.962037 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=189076) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:23:50.963063 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.lightos [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fec2:720d', 'fe80::f4ec:16ff:fe16:3ba5', 'fe80::fc16:3eff:fe6b:2533', 'fe80::fc16:3eff:fe8b:6175', 'fe80::fc16:3eff:fe9a:387d'] Jan 26 19:23:50.963185 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:23:50.963334 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:23:50.963611 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] <== get_connector_properties: return (67ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': True, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fec2:720d', 'fe80::f4ec:16ff:fe16:3ba5', 'fe80::fc16:3eff:fe6b:2533', 'fe80::fc16:3eff:fe8b:6175', 'fe80::fc16:3eff:fe9a:387d']} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:23:54.556632 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:55.126415 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Starting finish_migration {{(pid=189076) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12668}} Jan 26 19:23:55.127447 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Instance directory exists: not creating {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5157}} Jan 26 19:23:55.127593 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Creating image(s) Jan 26 19:23:55.129199 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:55.224744 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.095s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:55.225110 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:23:55.225316 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:55.296789 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk --force-share --output=json" returned: 0 in 0.070s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:55.296789 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Cannot resize image /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:23:55.801907 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Did not create local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5295}} Jan 26 19:23:55.801907 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Ensure instance console log exists: /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:23:55.802608 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:23:55.802608 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:23:55.802828 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:23:55.807898 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Start _get_guest_xml network_info=[{"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "vif_mac": "fa:16:3e:64:65:1e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': 'cab7d33f-6cfa-4f3d-9ce9-5095be80eb31', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe', 'target_lun': 0, 'volume_id': 'd13d5015-aabd-4db2-9327-ec66ee53bafe', 'auth_method': 'CHAP', 'auth_username': 't27GCDUif9ZHfCH3yDUn', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '03068296-12d4-4dbe-9770-c070e336a3bf', 'attached_at': '2026-01-27T00:23:54.000000', 'detached_at': '', 'volume_id': 'd13d5015-aabd-4db2-9327-ec66ee53bafe', 'multiattach': True, 'serial': 'd13d5015-aabd-4db2-9327-ec66ee53bafe'}, 'boot_index': None, 'device_type': 'disk', 'volume_type': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:23:55.812190 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:23:55.814068 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='03068296-12d4-4dbe-9770-c070e336a3bf'), owner=OwnerMeta(userid='d2494a2c41134b13a25b86d1bdfdd65f', username='tempest-AttachVolumeMultiAttachTest-1495503700-project-member', projectid='4a07dd99b19249acb501695a25608424', projectname='tempest-AttachVolumeMultiAttachTest-1495503700'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "vif_mac": "fa:16:3e:64:65:1e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769473435.8130891) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:23:55.814940 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:23:55.815351 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:23:55.816697 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:23:55.817056 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:23:55.818063 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:23:55.818471 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:23:55.818693 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:23:55.818909 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:23:55.819121 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:23:55.819284 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:23:55.819444 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:23:55.819679 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:23:55.819975 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:23:55.820175 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:23:55.820353 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:23:55.820541 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:23:55.823852 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk.config --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:55.893427 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk.config --force-share --output=json" returned: 0 in 0.069s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:55.893761 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "/opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:23:55.893949 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "/opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:23:55.894506 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "/opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:23:55.894861 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Calling os-brick to attach iSCSI Volume {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jan 26 19:23:55.895467 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe', 'target_lun': 0, 'volume_id': 'd13d5015-aabd-4db2-9327-ec66ee53bafe', 'auth_method': 'CHAP', 'auth_username': 't27GCDUif9ZHfCH3yDUn', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:23:55.895612 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:23:55.896070 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:23:55.896253 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe', 'target_lun': 0, 'volume_id': 'd13d5015-aabd-4db2-9327-ec66ee53bafe', 'auth_method': 'CHAP', 'auth_username': 't27GCDUif9ZHfCH3yDUn', 'auth_password': '8wKKK5H2F7ThGsAY', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True} {{(pid=189076) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:23:55.897789 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:55.901802 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:23:55.903854 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[9291ea77-132b-4c6a-866a-c8345105e2b8]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:23:55.903854 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:23:55.903854 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:23:55.903854 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:23:55.903854 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:23:55.903854 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:23:55.903854 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:23:55.903854 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:23:55.903854 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:23:55.903854 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:23:55.903854 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:23:55.903854 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:23:55.903854 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:23:55.903854 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:23:55.903854 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:23:55.903854 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:23:55.903854 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:23:55.903854 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:23:55.903854 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:23:55.903854 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:23:55.903854 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:23:55.903854 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:23:55.905659 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[9291ea77-132b-4c6a-866a-c8345105e2b8]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:55.906506 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:23:55.906981 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:23:55.907273 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:23:55.908249 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:55.918531 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:55.918987 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88cdb41-816a-46af-80c6-c1dab8a2bfde]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = t27GCDUif9ZHfCH3yDUn\nnode.session.auth.password = ********\nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.name = iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.tpgt = -1 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.startup = automatic Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.leading_login = No Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.iscsi_ifacename = default Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.net_ifacename = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.ipaddress = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.prefix_len = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.hwaddress = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.transport_name = tcp Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.initiatorname = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.state = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.vlan_id = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.vlan_priority = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.vlan_state = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.iface_num = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.mtu = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.port = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.bootproto = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.subnet_mask = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.gateway = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id_state = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.dhcp_dns = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.dhcp_learn_iqn = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.dhcp_req_vendor_id_state = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id_state = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.dhcp_slp_da = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.fragmentation = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.gratuitous_arp = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.incoming_forwarding = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.tos_state = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.tos = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.ttl = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.delayed_ack = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.tcp_nagle = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf_state = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.tcp_timer_scale = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.tcp_timestamp = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.redirect = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.def_task_mgmt_timeout = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.header_digest = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.data_digest = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.immediate_data = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.initial_r2t = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.data_seq_inorder = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.data_pdu_inorder = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.erl = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.max_receive_data_len = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.first_burst_len = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.max_outstanding_r2t = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.max_burst_len = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.chap_auth = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.bidi_chap = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.strict_login_compliance = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.discovery_auth = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: iface.discovery_logout = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.discovery_address = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.discovery_port = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.discovery_type = fw Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.initial_cmdsn = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.initial_login_retry_max = 8 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.xmit_thread_priority = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.cmds_max = 128 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.queue_depth = 32 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.nr_sessions = 1 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.auth.authmethod = CHAP Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.auth.username = t27GCDUif9ZHfCH3yDUn Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.auth.password = *** Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.auth.username_in = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.auth.password_in = Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.timeo.replacement_timeout = 120 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FastAbort = Yes Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.InitialR2T = No Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ImmediateData = Yes Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxConnections = 1 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ERL = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.scan = manual Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.reopen_max = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.session.conn_reopen_log_freq = 1 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.conn[0].address = 38.102.83.18 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.conn[0].port = 3260 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.conn[0].startup = manual Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.window_size = 524288 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.DataDigest = None Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.IFMarker = No Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.OFMarker = No Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: # END RECORD Jan 26 19:23:55.920261 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:23:55.921576 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:55.929146 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:55.929316 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b39a8a6-1efc-4738-bddb-c0ac6a733f8e]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:55.929693 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:23:55.930532 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:55.938601 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:55.938749 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a794f7-a496-4c5c-88d0-8148d8efa983]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:55.939169 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:23:55.939984 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.username -v t27GCDUif9ZHfCH3yDUn {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:55.949606 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.username -v t27GCDUif9ZHfCH3yDUn" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:55.949967 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73e798f-26b5-4f66-91e6-0835b2c2a064]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:55.950263 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 't27GCDUif9ZHfCH3yDUn'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:23:55.951404 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:55.960402 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:55.960559 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd1c4bc-0d2a-4055-b173-e9ac1203468b]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:55.961046 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:23:55.961851 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:55.974034 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:55.974230 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[160e8279-b1f1-4ef7-9eff-41762732d406]: (4, ('tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash)\ntcp: [30] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:55.974699 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:23:55.974699 np0005596550.novalocal nova-compute[189076]: tcp: [30] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe (non-flash) Jan 26 19:23:55.974699 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:23:55.974990 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsi session list stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:23:55.974990 np0005596550.novalocal nova-compute[189076]: tcp: [30] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe (non-flash) Jan 26 19:23:55.974990 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:23:55.975426 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.069s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:23:55.975717 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connected to 38.102.83.18:3260 {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:23:55.976305 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] HCTL ('3', '0', '0', 0) found on session 30 with lun 0 {{(pid=189076) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:23:55.976540 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Scanning host 3 c: 0, t: 0, l: 0) {{(pid=189076) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:23:55.977498 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host3/scan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:23:55.984606 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host3/scan" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:23:55.984788 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5318eb5-3728-4132-a615-75a5779942d0]: (4, ('0 0 0', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:23:55.985219 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching for a device in session 30 and hctl ('3', '0', '0', 0) yield: sdb {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:23:55.985794 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connected to sdb using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe', 'target_lun': 0, 'volume_id': 'd13d5015-aabd-4db2-9327-ec66ee53bafe', 'auth_method': 'CHAP', 'auth_username': 't27GCDUif9ZHfCH3yDUn', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True} {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:23:55.986381 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.090s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:23:55.986629 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] <== connect_volume: return (90ms) {'type': 'block', 'scsi_wwn': '3600140528028ae1b6c44b1bbb2023c5c', 'path': '/dev/sdb'} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:23:55.986872 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3600140528028ae1b6c44b1bbb2023c5c', 'path': '/dev/sdb'} {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jan 26 19:23:56.494853 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:22:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='multiattach-server-1',id=105,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2DqNsC6gMM/rMUhFP33wutEbCJfSUZoLXi4knAQI7cL83VCjf4w8Ol5UVNVyCMMM4G5N6GoZa1daASRvj6YYLKi4Cz6e/HnHlp1PtG4CCeiOBWtfpou2xsaXI9ivoyQw==',key_name='tempest-keypair-1141931557',keypairs=,launch_index=0,launched_at=2026-01-27T00:22:24Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-yxpzl051',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:23:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=03068296-12d4-4dbe-9770-c070e336a3bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "vif_mac": "fa:16:3e:64:65:1e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:23:56.495104 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "vif_mac": "fa:16:3e:64:65:1e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:23:56.495907 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:65:1e,bridge_name='br-int',has_traffic_filtering=True,id=c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0932d0a-9e') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] End _get_guest_xml xml= Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: 03068296-12d4-4dbe-9770-c070e336a3bf Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: instance-00000069 Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: 262144 Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: multiattach-server-1 Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:23:55 Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: 256 Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: ide Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: pc Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: tempest-AttachVolumeMultiAttachTest-1495503700-project-member Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: tempest-AttachVolumeMultiAttachTest-1495503700 Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: 03068296-12d4-4dbe-9770-c070e336a3bf Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: 03068296-12d4-4dbe-9770-c070e336a3bf Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: d13d5015-aabd-4db2-9327-ec66ee53bafe Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: Jan 26 19:23:56.498479 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:23:56.500339 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:22:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='multiattach-server-1',id=105,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2DqNsC6gMM/rMUhFP33wutEbCJfSUZoLXi4knAQI7cL83VCjf4w8Ol5UVNVyCMMM4G5N6GoZa1daASRvj6YYLKi4Cz6e/HnHlp1PtG4CCeiOBWtfpou2xsaXI9ivoyQw==',key_name='tempest-keypair-1141931557',keypairs=,launch_index=0,launched_at=2026-01-27T00:22:24Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0005596550.novalocal',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-yxpzl051',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:23:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=03068296-12d4-4dbe-9770-c070e336a3bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "vif_mac": "fa:16:3e:64:65:1e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:23:56.500339 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "vif_mac": "fa:16:3e:64:65:1e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:23:56.500495 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:65:1e,bridge_name='br-int',has_traffic_filtering=True,id=c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0932d0a-9e') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:23:56.500495 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:65:1e,bridge_name='br-int',has_traffic_filtering=True,id=c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0932d0a-9e') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:23:56.500711 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:56.501199 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:23:56.501591 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:23:56.502513 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:56.502745 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e3a78d3-1501-5394-8771-23c32066d1ac', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:23:56.504482 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:56.506590 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:56.509450 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:56.509670 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0932d0a-9e, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:23:56.510277 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc0932d0a-9e, col_values=(('qos', UUID('d5cf323e-d0b9-4b14-8806-a0aa9b15951a')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:23:56.510277 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc0932d0a-9e, col_values=(('external_ids', {'iface-id': 'c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:65:1e', 'vm-uuid': '03068296-12d4-4dbe-9770-c070e336a3bf'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:23:56.513296 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:56.515126 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:23:56.525835 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:56.526707 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:65:1e,bridge_name='br-int',has_traffic_filtering=True,id=c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0932d0a-9e') Jan 26 19:23:58.069483 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:23:58.070088 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:23:58.070088 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:23:58.070299 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No VIF found with MAC fa:16:3e:64:65:1e, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:23:58.071505 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Using config drive Jan 26 19:23:58.199245 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:58.209608 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:58.216735 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:58.332496 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:58.334156 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:58.368795 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-2dbd3cb3-d11b-4d69-9cfc-ea4b88b23741 req-a42276d5-843e-46d6-9e29-7f22154d18e5 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Received event network-vif-plugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:23:58.368981 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2dbd3cb3-d11b-4d69-9cfc-ea4b88b23741 req-a42276d5-843e-46d6-9e29-7f22154d18e5 service nova] Acquiring lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:23:58.369206 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2dbd3cb3-d11b-4d69-9cfc-ea4b88b23741 req-a42276d5-843e-46d6-9e29-7f22154d18e5 service nova] Lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:23:58.369397 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2dbd3cb3-d11b-4d69-9cfc-ea4b88b23741 req-a42276d5-843e-46d6-9e29-7f22154d18e5 service nova] Lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:23:58.369598 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-2dbd3cb3-d11b-4d69-9cfc-ea4b88b23741 req-a42276d5-843e-46d6-9e29-7f22154d18e5 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] No waiting events found dispatching network-vif-plugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:23:58.373742 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-2dbd3cb3-d11b-4d69-9cfc-ea4b88b23741 req-a42276d5-843e-46d6-9e29-7f22154d18e5 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Received unexpected event network-vif-plugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f for instance with vm_state active and task_state resize_finish. Jan 26 19:23:58.421858 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Instance event wait completed in 0 seconds for {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:23:58.424949 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Removed pending event for 03068296-12d4-4dbe-9770-c070e336a3bf due to event {{(pid=189076) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:439}} Jan 26 19:23:58.425233 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:23:58.425447 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] VM Resumed (Lifecycle Event) Jan 26 19:23:58.428863 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Instance running successfully. Jan 26 19:23:58.430691 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Failed to set time: agent not configured {{(pid=189076) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}} Jan 26 19:23:58.430888 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-3c8c50ff-b64f-4c22-b039-65d0a0a17ded tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] finish_migration finished successfully. {{(pid=189076) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12763}} Jan 26 19:23:58.474861 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:23:58.931072 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:23:58.935691 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:23:59.439326 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] During sync_power_state the instance has a pending task (resize_finish). Skip. Jan 26 19:23:59.439910 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:23:59.440014 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] VM Started (Lifecycle Event) Jan 26 19:23:59.943480 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:23:59.947602 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:24:00.444388 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-2156054f-b21d-4945-b462-1cb847ac4c2b req-7f5d4bbb-c1c1-4f0f-8a9c-17afad6c761c service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Received event network-vif-plugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:24:00.444861 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2156054f-b21d-4945-b462-1cb847ac4c2b req-7f5d4bbb-c1c1-4f0f-8a9c-17afad6c761c service nova] Acquiring lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:24:00.445270 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2156054f-b21d-4945-b462-1cb847ac4c2b req-7f5d4bbb-c1c1-4f0f-8a9c-17afad6c761c service nova] Lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:24:00.445626 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-2156054f-b21d-4945-b462-1cb847ac4c2b req-7f5d4bbb-c1c1-4f0f-8a9c-17afad6c761c service nova] Lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:24:00.448453 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-2156054f-b21d-4945-b462-1cb847ac4c2b req-7f5d4bbb-c1c1-4f0f-8a9c-17afad6c761c service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] No waiting events found dispatching network-vif-plugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:24:00.448453 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-2156054f-b21d-4945-b462-1cb847ac4c2b req-7f5d4bbb-c1c1-4f0f-8a9c-17afad6c761c service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Received unexpected event network-vif-plugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f for instance with vm_state resized and task_state None. Jan 26 19:24:00.767003 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44a8f454-e73e-4ffd-b2c0-11a37ef61a15 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "03068296-12d4-4dbe-9770-c070e336a3bf" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:24:00.767413 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44a8f454-e73e-4ffd-b2c0-11a37ef61a15 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "03068296-12d4-4dbe-9770-c070e336a3bf" acquired by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:24:00.767719 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-44a8f454-e73e-4ffd-b2c0-11a37ef61a15 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Going to confirm migration 10 {{(pid=189076) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5331}} Jan 26 19:24:01.273321 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-44a8f454-e73e-4ffd-b2c0-11a37ef61a15 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:24:01.320864 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-44a8f454-e73e-4ffd-b2c0-11a37ef61a15 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:24:01.321117 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44a8f454-e73e-4ffd-b2c0-11a37ef61a15 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:24:01.321244 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44a8f454-e73e-4ffd-b2c0-11a37ef61a15 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquired lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:24:01.321406 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-44a8f454-e73e-4ffd-b2c0-11a37ef61a15 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:24:01.321616 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-44a8f454-e73e-4ffd-b2c0-11a37ef61a15 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'info_cache' on Instance uuid 03068296-12d4-4dbe-9770-c070e336a3bf {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:24:01.512716 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:02.331447 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-44a8f454-e73e-4ffd-b2c0-11a37ef61a15 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:24:02.542899 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-44a8f454-e73e-4ffd-b2c0-11a37ef61a15 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:24:02.646885 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-44a8f454-e73e-4ffd-b2c0-11a37ef61a15 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Updating instance_info_cache with network_info: [{"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:24:03.150091 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44a8f454-e73e-4ffd-b2c0-11a37ef61a15 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Releasing lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:24:03.150268 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-44a8f454-e73e-4ffd-b2c0-11a37ef61a15 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'migration_context' on Instance uuid 03068296-12d4-4dbe-9770-c070e336a3bf {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:24:03.657317 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-44a8f454-e73e-4ffd-b2c0-11a37ef61a15 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Object Instance<03068296-12d4-4dbe-9770-c070e336a3bf> lazy-loaded attributes: info_cache,migration_context {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:24:03.657317 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44a8f454-e73e-4ffd-b2c0-11a37ef61a15 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:24:03.657317 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44a8f454-e73e-4ffd-b2c0-11a37ef61a15 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:24:04.451679 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-44a8f454-e73e-4ffd-b2c0-11a37ef61a15 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:24:04.958270 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-44a8f454-e73e-4ffd-b2c0-11a37ef61a15 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:24:05.971103 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44a8f454-e73e-4ffd-b2c0-11a37ef61a15 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.314s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:24:06.513942 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:24:06.515168 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:06.515168 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:24:06.515168 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:24:06.515168 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:24:06.515168 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:06.607784 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-44a8f454-e73e-4ffd-b2c0-11a37ef61a15 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Deleted allocation for migration 4cb998a1-3677-40ee-9baf-6587382af831 Jan 26 19:24:07.111718 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-44a8f454-e73e-4ffd-b2c0-11a37ef61a15 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "03068296-12d4-4dbe-9770-c070e336a3bf" "released" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: held 6.344s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:24:07.991714 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6ee62871-ff5f-4aca-9673-14ad65d89100 req-3fae1298-2ecd-46ae-b233-e848cf17e293 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Received event network-changed-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:24:07.991914 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6ee62871-ff5f-4aca-9673-14ad65d89100 req-3fae1298-2ecd-46ae-b233-e848cf17e293 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Refreshing instance network info cache due to event network-changed-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:24:07.992088 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6ee62871-ff5f-4aca-9673-14ad65d89100 req-3fae1298-2ecd-46ae-b233-e848cf17e293 service nova] Acquiring lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:24:07.992199 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6ee62871-ff5f-4aca-9673-14ad65d89100 req-3fae1298-2ecd-46ae-b233-e848cf17e293 service nova] Acquired lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:24:07.992325 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-6ee62871-ff5f-4aca-9673-14ad65d89100 req-3fae1298-2ecd-46ae-b233-e848cf17e293 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Refreshing network info cache for port 2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:24:08.477404 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:08.496327 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-6ee62871-ff5f-4aca-9673-14ad65d89100 req-3fae1298-2ecd-46ae-b233-e848cf17e293 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:24:08.796073 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-6ee62871-ff5f-4aca-9673-14ad65d89100 req-3fae1298-2ecd-46ae-b233-e848cf17e293 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:24:08.913330 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-6ee62871-ff5f-4aca-9673-14ad65d89100 req-3fae1298-2ecd-46ae-b233-e848cf17e293 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Updated VIF entry in instance network info cache for port 2a61c5d0-be1d-4c00-9d7b-8854ff697d7f. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:24:08.913636 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-6ee62871-ff5f-4aca-9673-14ad65d89100 req-3fae1298-2ecd-46ae-b233-e848cf17e293 service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Updating instance_info_cache with network_info: [{"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:24:09.416402 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6ee62871-ff5f-4aca-9673-14ad65d89100 req-3fae1298-2ecd-46ae-b233-e848cf17e293 service nova] Releasing lock "refresh_cache-7985cac9-68f6-40e7-bb90-7761b4220db7" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:24:10.060236 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a71aee83-96e3-4c80-9323-eb78b6d1a74c req-2125660e-0528-41f7-88cd-e3674329c1af service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Received event network-changed-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:24:10.060798 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a71aee83-96e3-4c80-9323-eb78b6d1a74c req-2125660e-0528-41f7-88cd-e3674329c1af service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Refreshing instance network info cache due to event network-changed-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:24:10.060798 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a71aee83-96e3-4c80-9323-eb78b6d1a74c req-2125660e-0528-41f7-88cd-e3674329c1af service nova] Acquiring lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:24:10.060958 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a71aee83-96e3-4c80-9323-eb78b6d1a74c req-2125660e-0528-41f7-88cd-e3674329c1af service nova] Acquired lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:24:10.061591 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-a71aee83-96e3-4c80-9323-eb78b6d1a74c req-2125660e-0528-41f7-88cd-e3674329c1af service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Refreshing network info cache for port c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:24:10.565399 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-a71aee83-96e3-4c80-9323-eb78b6d1a74c req-2125660e-0528-41f7-88cd-e3674329c1af service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:24:10.860473 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-a71aee83-96e3-4c80-9323-eb78b6d1a74c req-2125660e-0528-41f7-88cd-e3674329c1af service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:24:10.941667 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-a71aee83-96e3-4c80-9323-eb78b6d1a74c req-2125660e-0528-41f7-88cd-e3674329c1af service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Updated VIF entry in instance network info cache for port c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:24:10.941955 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-a71aee83-96e3-4c80-9323-eb78b6d1a74c req-2125660e-0528-41f7-88cd-e3674329c1af service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Updating instance_info_cache with network_info: [{"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:24:11.444663 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a71aee83-96e3-4c80-9323-eb78b6d1a74c req-2125660e-0528-41f7-88cd-e3674329c1af service nova] Releasing lock "refresh_cache-03068296-12d4-4dbe-9770-c070e336a3bf" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:24:11.517201 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:13.476876 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:16.518852 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:18.478562 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:21.521501 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:22.674238 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bc0150b1-3685-4c41-8d56-3385d28db308 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "7985cac9-68f6-40e7-bb90-7761b4220db7" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:24:22.674590 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bc0150b1-3685-4c41-8d56-3385d28db308 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:24:23.178635 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-bc0150b1-3685-4c41-8d56-3385d28db308 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Detaching volume d13d5015-aabd-4db2-9327-ec66ee53bafe Jan 26 19:24:23.223972 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.block_device [None req-bc0150b1-3685-4c41-8d56-3385d28db308 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Attempting to driver detach volume d13d5015-aabd-4db2-9327-ec66ee53bafe from mountpoint /dev/vdb Jan 26 19:24:23.231294 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bc0150b1-3685-4c41-8d56-3385d28db308 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Found disk vdb by alias ua-d13d5015-aabd-4db2-9327-ec66ee53bafe {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:24:23.233286 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bc0150b1-3685-4c41-8d56-3385d28db308 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Found disk vdb by alias ua-d13d5015-aabd-4db2-9327-ec66ee53bafe {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:24:23.233487 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bc0150b1-3685-4c41-8d56-3385d28db308 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Attempting to detach device vdb from instance 7985cac9-68f6-40e7-bb90-7761b4220db7 from the persistent domain config. {{(pid=189076) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2599}} Jan 26 19:24:23.233843 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-bc0150b1-3685-4c41-8d56-3385d28db308 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] detach device xml: Jan 26 19:24:23.233843 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:23.233843 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:23.233843 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:23.233843 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:23.233843 np0005596550.novalocal nova-compute[189076]: d13d5015-aabd-4db2-9327-ec66ee53bafe Jan 26 19:24:23.233843 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:23.233843 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:24:23.233843 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:23.233843 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:24:23.241941 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bc0150b1-3685-4c41-8d56-3385d28db308 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Found disk vdb by alias ua-d13d5015-aabd-4db2-9327-ec66ee53bafe {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:24:23.242178 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-bc0150b1-3685-4c41-8d56-3385d28db308 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Failed to detach device vdb from instance 7985cac9-68f6-40e7-bb90-7761b4220db7 from the persistent domain config. Libvirt did not report any error but the device is still in the config. Jan 26 19:24:23.242414 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bc0150b1-3685-4c41-8d56-3385d28db308 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] (1/8): Attempting to detach device vdb with device alias ua-d13d5015-aabd-4db2-9327-ec66ee53bafe from instance 7985cac9-68f6-40e7-bb90-7761b4220db7 from the live domain config. {{(pid=189076) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2633}} Jan 26 19:24:23.242834 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-bc0150b1-3685-4c41-8d56-3385d28db308 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] detach device xml: Jan 26 19:24:23.242834 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:23.242834 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:23.242834 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:23.242834 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:23.242834 np0005596550.novalocal nova-compute[189076]: d13d5015-aabd-4db2-9327-ec66ee53bafe Jan 26 19:24:23.242834 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:23.242834 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:24:23.242834 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:23.242834 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:24:23.372973 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Received event ua-d13d5015-aabd-4db2-9327-ec66ee53bafe> from libvirt while the driver is waiting for it; dispatched. {{(pid=189076) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2486}} Jan 26 19:24:23.373431 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-bc0150b1-3685-4c41-8d56-3385d28db308 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d13d5015-aabd-4db2-9327-ec66ee53bafe for instance 7985cac9-68f6-40e7-bb90-7761b4220db7 {{(pid=189076) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2713}} Jan 26 19:24:23.376530 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bc0150b1-3685-4c41-8d56-3385d28db308 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Successfully detached device vdb from instance 7985cac9-68f6-40e7-bb90-7761b4220db7 from the live domain config. Jan 26 19:24:23.483020 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:23.906184 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-bc0150b1-3685-4c41-8d56-3385d28db308 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Detected multiple connections on this host for volume: d13d5015-aabd-4db2-9327-ec66ee53bafe, skipping target disconnect. Jan 26 19:24:24.482075 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-bc0150b1-3685-4c41-8d56-3385d28db308 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'flavor' on Instance uuid 7985cac9-68f6-40e7-bb90-7761b4220db7 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:24:25.490932 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-bc0150b1-3685-4c41-8d56-3385d28db308 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 2.816s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:24:26.057141 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "03068296-12d4-4dbe-9770-c070e336a3bf" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:24:26.057487 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "03068296-12d4-4dbe-9770-c070e336a3bf" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:24:26.523781 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:26.561910 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Detaching volume d13d5015-aabd-4db2-9327-ec66ee53bafe Jan 26 19:24:26.623470 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.block_device [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Attempting to driver detach volume d13d5015-aabd-4db2-9327-ec66ee53bafe from mountpoint /dev/vdb Jan 26 19:24:26.630807 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Found disk vdb by alias ua-d13d5015-aabd-4db2-9327-ec66ee53bafe {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:24:26.633200 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Found disk vdb by alias ua-d13d5015-aabd-4db2-9327-ec66ee53bafe {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:24:26.633200 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Attempting to detach device vdb from instance 03068296-12d4-4dbe-9770-c070e336a3bf from the persistent domain config. {{(pid=189076) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2599}} Jan 26 19:24:26.633200 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] detach device xml: Jan 26 19:24:26.633200 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:26.633200 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:26.633200 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:26.633200 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:26.633200 np0005596550.novalocal nova-compute[189076]: d13d5015-aabd-4db2-9327-ec66ee53bafe Jan 26 19:24:26.633200 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:26.633200 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:24:26.633200 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:26.633200 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:24:26.643281 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Found disk vdb by alias ua-d13d5015-aabd-4db2-9327-ec66ee53bafe {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:24:26.643599 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Failed to detach device vdb from instance 03068296-12d4-4dbe-9770-c070e336a3bf from the persistent domain config. Libvirt did not report any error but the device is still in the config. Jan 26 19:24:26.644229 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] (1/8): Attempting to detach device vdb with device alias ua-d13d5015-aabd-4db2-9327-ec66ee53bafe from instance 03068296-12d4-4dbe-9770-c070e336a3bf from the live domain config. {{(pid=189076) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2633}} Jan 26 19:24:26.644739 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] detach device xml: Jan 26 19:24:26.644739 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:26.644739 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:26.644739 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:26.644739 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:26.644739 np0005596550.novalocal nova-compute[189076]: d13d5015-aabd-4db2-9327-ec66ee53bafe Jan 26 19:24:26.644739 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:26.644739 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:24:26.644739 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:26.644739 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:24:26.742357 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Received event ua-d13d5015-aabd-4db2-9327-ec66ee53bafe> from libvirt while the driver is waiting for it; dispatched. {{(pid=189076) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2486}} Jan 26 19:24:26.743210 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d13d5015-aabd-4db2-9327-ec66ee53bafe for instance 03068296-12d4-4dbe-9770-c070e336a3bf {{(pid=189076) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2713}} Jan 26 19:24:26.748020 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Successfully detached device vdb from instance 03068296-12d4-4dbe-9770-c070e336a3bf from the live domain config. Jan 26 19:24:26.799655 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] calling os-brick to detach iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jan 26 19:24:26.800383 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe', 'target_lun': 0, 'volume_id': 'd13d5015-aabd-4db2-9327-ec66ee53bafe', 'auth_method': 'CHAP', 'auth_username': 't27GCDUif9ZHfCH3yDUn', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:24:26.800589 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:24:26.801003 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:24:26.802301 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:26.815276 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:26.815568 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad619b7-bae7-45e6-bd50-dc51460db29e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:26.816158 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:24:26.816158 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:24:26.816158 np0005596550.novalocal nova-compute[189076]: iSNS: Jan 26 19:24:26.816158 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:24:26.816158 np0005596550.novalocal nova-compute[189076]: STATIC: Jan 26 19:24:26.816158 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 Jan 26 19:24:26.816158 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:24:26.816158 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:24:26.816158 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe Jan 26 19:24:26.816158 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:24:26.816158 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:24:26.816158 np0005596550.novalocal nova-compute[189076]: FIRMWARE: Jan 26 19:24:26.816158 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:24:26.816158 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:24:26.816508 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:24:26.816508 np0005596550.novalocal nova-compute[189076]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:24:26.816508 np0005596550.novalocal nova-compute[189076]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=189076) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:24:26.816979 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe', 0)] {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:24:26.818093 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:26.830647 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:26.831044 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[27513ad1-9dc1-4f2c-9179-7c9e2558a6e5]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2\n38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:26.832370 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:26.846060 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.014s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:26.846434 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[570c92d7-3a51-47df-8e30-63c5577a07a2]: (4, ('tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash)\ntcp: [30] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:26.846992 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:24:26.846992 np0005596550.novalocal nova-compute[189076]: tcp: [30] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe (non-flash) Jan 26 19:24:26.846992 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:24:26.847305 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsi session list stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:24:26.847305 np0005596550.novalocal nova-compute[189076]: tcp: [30] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe (non-flash) Jan 26 19:24:26.847305 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:24:26.848369 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Resulting device map defaultdict(. at 0x7fd72c312c00>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe'): ({'sdb'}, set())}) {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:24:26.848849 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Removing single pathed devices sdb {{(pid=189076) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:24:26.849929 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:26.856987 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:24:26.858486 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[301bc6e4-54cf-4e0b-a3c2-6699bae71d4e]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:24:26.858486 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:24:26.858486 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:24:26.858486 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:24:26.858486 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:24:26.858486 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:24:26.858486 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:24:26.858486 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:24:26.858486 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:24:26.858486 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:24:26.858486 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:24:26.858486 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:24:26.858486 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:24:26.858486 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:24:26.858486 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:24:26.858486 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:24:26.858486 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:24:26.858486 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:24:26.858486 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:24:26.858486 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:24:26.858486 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:24:26.858486 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:24:26.859626 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[301bc6e4-54cf-4e0b-a3c2-6699bae71d4e]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:26.860582 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Flushing IO for device /dev/sdb {{(pid=189076) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:24:26.861823 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:26.871712 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:26.872048 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1440ac-9108-49bb-a16b-43f1c87d18b8]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:26.872518 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=189076) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:24:26.873469 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:26.895657 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:24:26.896125 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:24:26.932499 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:26.932594 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[309c012a-f047-46b0-92e2-a0b302ba2f1f]: (4, ('1', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:26.933085 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:24:26.933085 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] SCSI volumes sdb have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:24:26.933545 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe')] {{(pid=189076) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:24:26.934978 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:26.945616 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:26.946003 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[17316b26-084d-403d-ab95-fd14a96920b1]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:26.946602 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:24:26.948919 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --logout {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:26.983875 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --logout" returned: 0 in 0.035s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:26.984145 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ab072b-a737-42bc-99bf-a279a5044ca2]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe, portal: 38.102.83.18,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:26.984682 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe, portal: 38.102.83.18,3260] Jan 26 19:24:26.984682 np0005596550.novalocal nova-compute[189076]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe, portal: 38.102.83.18,3260] successful. Jan 26 19:24:26.984682 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:24:26.985566 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:26.994903 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-d13d5015-aabd-4db2-9327-ec66ee53bafe -p 38.102.83.18:3260 --op delete" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:26.995234 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[182de03b-f11d-4b37-90e8-d664004e137c]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:26.995739 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:24:26.996221 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.195s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:24:26.996513 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] <== disconnect_volume: return (195ms) None {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:24:26.996844 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Disconnected iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jan 26 19:24:28.484274 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:29.402383 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:24:29.402383 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Cleaning up deleted instances {{(pid=189076) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11960}} Jan 26 19:24:29.905112 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] There are 0 instances to clean {{(pid=189076) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11969}} Jan 26 19:24:30.056904 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'flavor' on Instance uuid 03068296-12d4-4dbe-9770-c070e336a3bf {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:24:31.067384 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-6ec7433d-0511-457f-ae05-3e24664aeeb2 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "03068296-12d4-4dbe-9770-c070e336a3bf" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 5.010s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:24:31.526231 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:32.400441 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:24:32.906926 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:24:32.907190 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:24:32.907479 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:24:32.907813 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:24:33.954545 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:34.033531 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:34.034328 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:34.140437 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:34.144437 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:34.202897 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk --force-share --output=json" returned: 0 in 0.058s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:34.203510 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:34.267732 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk --force-share --output=json" returned: 0 in 0.064s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:34.271565 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:34.333759 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk --force-share --output=json" returned: 0 in 0.062s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:34.334721 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:34.397269 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805/disk --force-share --output=json" returned: 0 in 0.062s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:34.401131 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] skipping disk /dev/sda (vda) as it is a volume {{(pid=189076) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12209}} Jan 26 19:24:34.403195 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:34.463333 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk --force-share --output=json" returned: 0 in 0.060s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:34.463761 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:34.523243 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf/disk --force-share --output=json" returned: 0 in 0.059s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:34.596583 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:24:34.597478 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:34.615582 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.018s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:34.615877 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=6433MB free_disk=371.68750381469727GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:24:34.616011 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:24:34.616305 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:24:35.681378 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance a7010931-641e-45d6-a8df-edd43c91ae9b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:24:35.682017 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance dbcbca53-6fab-4827-b3dc-a25e7eb6bb70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:24:35.682017 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 28db8142-2f27-4207-923f-f2f525867805 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:24:35.682017 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 7985cac9-68f6-40e7-bb90-7761b4220db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:24:35.682017 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 03068296-12d4-4dbe-9770-c070e336a3bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:24:36.111210 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "c81257f9-fd45-451e-a71b-680f4c383553" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:24:36.111387 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "c81257f9-fd45-451e-a71b-680f4c383553" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:24:36.186694 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance c81257f9-fd45-451e-a71b-680f4c383553 has allocations against this compute host but is not found in the database. Jan 26 19:24:36.186921 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 5 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:24:36.187092 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=1600MB phys_disk=399GB used_disk=4GB total_vcpus=8 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:24:34 up 52 min, 13 users, load average: 1.48, 2.96, 3.71\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '5', 'num_proj_4a07dd99b19249acb501695a25608424': '5', 'io_workload': '0'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:24:36.216608 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Refreshing inventories for resource provider f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}} Jan 26 19:24:36.242404 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Updating ProviderTree inventory for provider f627156c-932e-4a32-97b3-315a994a2ac9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}} Jan 26 19:24:36.242559 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Updating inventory in ProviderTree for provider f627156c-932e-4a32-97b3-315a994a2ac9 with inventory: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jan 26 19:24:36.265097 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Refreshing aggregate associations for resource provider f627156c-932e-4a32-97b3-315a994a2ac9, aggregates: None {{(pid=189076) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}} Jan 26 19:24:36.292519 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Refreshing trait associations for resource provider f627156c-932e-4a32-97b3-315a994a2ac9, traits: COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_ADDRESS_SPACE_EMULATED,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOUND_MODEL_SB16,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_IGB,HW_ARCH_X86_64,COMPUTE_ARCH_X86_64,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_SECURITY_STATELESS_FIRMWARE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOUND_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOUND_MODEL_AC97,COMPUTE_SOUND_MODEL_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ADDRESS_SPACE_PASSTHROUGH {{(pid=189076) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}} Jan 26 19:24:36.485690 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:24:36.527485 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:24:36.528463 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:36.528555 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:24:36.528646 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:24:36.528926 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:24:36.529136 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:36.614047 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:24:36.989995 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:24:37.155436 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:24:37.495721 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:24:37.495873 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.880s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:24:37.496128 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.341s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:24:37.499386 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:24:37.499662 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Claim successful on node np0005596550.novalocal Jan 26 19:24:38.736522 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:24:38.992015 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:24:38.992182 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:24:38.992329 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:24:38.992478 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:24:39.241587 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:24:39.752942 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.256s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:24:39.753646 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:24:39.891940 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:24:40.304247 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:24:40.304434 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:24:40.304700 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:24:40.304967 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:24:40.385560 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2494a2c41134b13a25b86d1bdfdd65f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a07dd99b19249acb501695a25608424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:24:40.686465 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:40.808656 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:24:40.944062 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:24:40.944062 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:24:40.944062 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Successfully created port: 7882b9a2-4014-4950-b3f8-9ed20ce7a9d5 {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:24:41.313901 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:24:41.401453 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Successfully updated port: 7882b9a2-4014-4950-b3f8-9ed20ce7a9d5 {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:24:41.436120 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-077a7d78-755d-4cfd-a782-9062893cfa6e req-bd8142ee-c273-40f2-8f4b-d1e608cccf7b service nova] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Received event network-changed-7882b9a2-4014-4950-b3f8-9ed20ce7a9d5 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:24:41.436604 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-077a7d78-755d-4cfd-a782-9062893cfa6e req-bd8142ee-c273-40f2-8f4b-d1e608cccf7b service nova] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Refreshing instance network info cache due to event network-changed-7882b9a2-4014-4950-b3f8-9ed20ce7a9d5. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:24:41.436604 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-077a7d78-755d-4cfd-a782-9062893cfa6e req-bd8142ee-c273-40f2-8f4b-d1e608cccf7b service nova] Acquiring lock "refresh_cache-c81257f9-fd45-451e-a71b-680f4c383553" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:24:41.436993 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-077a7d78-755d-4cfd-a782-9062893cfa6e req-bd8142ee-c273-40f2-8f4b-d1e608cccf7b service nova] Acquired lock "refresh_cache-c81257f9-fd45-451e-a71b-680f4c383553" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:24:41.437285 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-077a7d78-755d-4cfd-a782-9062893cfa6e req-bd8142ee-c273-40f2-8f4b-d1e608cccf7b service nova] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Refreshing network info cache for port 7882b9a2-4014-4950-b3f8-9ed20ce7a9d5 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:24:41.530802 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:41.820979 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.block_device [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Booting with volume 26bc1c0c-1b78-4a7b-a84f-89c50e00950a at /dev/vda Jan 26 19:24:41.876803 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': True, 'host': 'np0005596550.novalocal', 'execute': None}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:24:41.880412 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:41.890666 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:41.891187 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b253061-edaa-47f4-8ff3-ef6c67bd96d2]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:41.894488 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[d4ad3b30-42fa-4f9b-8c77-e71f7b1aa6d5]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:24:41.894488 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:24:41.894488 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:24:41.894488 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:24:41.894488 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:24:41.894488 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:24:41.894488 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:24:41.894488 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:24:41.894488 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:24:41.894488 np0005596550.novalocal nova-compute[189076]: with open_scini_device() as fd: Jan 26 19:24:41.894488 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:24:41.894488 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:24:41.894488 np0005596550.novalocal nova-compute[189076]: return next(self.gen) Jan 26 19:24:41.894488 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^ Jan 26 19:24:41.894488 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:24:41.894488 np0005596550.novalocal nova-compute[189076]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:24:41.894488 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:24:41.894488 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:24:41.896967 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ad3b30-42fa-4f9b-8c77-e71f7b1aa6d5]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:41.896967 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.scaleio [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:24:41.896967 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.scaleio [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:24:41.897714 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:41.904856 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "refresh_cache-c81257f9-fd45-451e-a71b-680f4c383553" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:24:41.908727 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:41.909170 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[12727b2f-d29e-4a4c-9c94-d858f6efc9ad]: (4, ('/dev/vda2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:41.911796 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:41.923328 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:41.923911 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7401c6-fed7-448d-a2e2-b2249a2b4564]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:41.926198 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3ae41c-853f-47f2-9622-39d4a8a1c523]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:41.926688 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): nvme version {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:41.942904 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-077a7d78-755d-4cfd-a782-9062893cfa6e req-bd8142ee-c273-40f2-8f4b-d1e608cccf7b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:24:41.945653 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] 'nvme version' failed. Not Retrying. {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:24:41.958503 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] nvme not present on system {{(pid=189076) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:24:41.963156 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=189076) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:24:41.964204 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.lightos [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fec2:720d', 'fe80::f4ec:16ff:fe16:3ba5', 'fe80::fc16:3eff:fe6b:2533', 'fe80::fc16:3eff:fe8b:6175', 'fe80::fc16:3eff:fe9a:387d', 'fe80::fc16:3eff:fe64:651e'] Jan 26 19:24:41.964464 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:24:41.964640 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:24:41.964979 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': True, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fec2:720d', 'fe80::f4ec:16ff:fe16:3ba5', 'fe80::fc16:3eff:fe6b:2533', 'fe80::fc16:3eff:fe8b:6175', 'fe80::fc16:3eff:fe9a:387d', 'fe80::fc16:3eff:fe64:651e']} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:24:41.965276 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.block_device [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Updating existing volume attachment record: ff3f0574-72e7-405a-9d46-e885bdcc4faa {{(pid=189076) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jan 26 19:24:41.992816 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-077a7d78-755d-4cfd-a782-9062893cfa6e req-bd8142ee-c273-40f2-8f4b-d1e608cccf7b service nova] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:24:42.215811 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-077a7d78-755d-4cfd-a782-9062893cfa6e req-bd8142ee-c273-40f2-8f4b-d1e608cccf7b service nova] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:24:42.721805 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-077a7d78-755d-4cfd-a782-9062893cfa6e req-bd8142ee-c273-40f2-8f4b-d1e608cccf7b service nova] Releasing lock "refresh_cache-c81257f9-fd45-451e-a71b-680f4c383553" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:24:42.721805 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquired lock "refresh_cache-c81257f9-fd45-451e-a71b-680f4c383553" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:24:42.721805 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:24:43.308237 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:24:43.467796 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:24:43.604513 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Updating instance_info_cache with network_info: [{"id": "7882b9a2-4014-4950-b3f8-9ed20ce7a9d5", "address": "fa:16:3e:27:9a:3d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7882b9a2-40", "ovs_interfaceid": "7882b9a2-4014-4950-b3f8-9ed20ce7a9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:24:44.109282 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Releasing lock "refresh_cache-c81257f9-fd45-451e-a71b-680f4c383553" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:24:44.110253 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Instance network_info: |[{"id": "7882b9a2-4014-4950-b3f8-9ed20ce7a9d5", "address": "fa:16:3e:27:9a:3d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7882b9a2-40", "ovs_interfaceid": "7882b9a2-4014-4950-b3f8-9ed20ce7a9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:24:46.531962 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:24:46.533507 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:46.533507 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:24:46.533619 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:24:46.534113 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:24:46.534513 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:47.567570 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:24:47.569687 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:24:47.570256 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Creating image(s) Jan 26 19:24:47.570889 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Did not create local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5295}} Jan 26 19:24:47.571216 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Ensure instance console log exists: /opt/stack/data/nova/instances/c81257f9-fd45-451e-a71b-680f4c383553/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:24:47.571727 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:24:47.572127 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:24:47.572428 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:24:47.575926 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Start _get_guest_xml network_info=[{"id": "7882b9a2-4014-4950-b3f8-9ed20ce7a9d5", "address": "fa:16:3e:27:9a:3d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7882b9a2-40", "ovs_interfaceid": "7882b9a2-4014-4950-b3f8-9ed20ce7a9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'ff3f0574-72e7-405a-9d46-e885bdcc4faa', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a', 'target_lun': 0, 'volume_id': '26bc1c0c-1b78-4a7b-a84f-89c50e00950a', 'auth_method': 'CHAP', 'auth_username': '8tk84jfYMxaDptvxyHCD', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c81257f9-fd45-451e-a71b-680f4c383553', 'attached_at': '', 'detached_at': '', 'volume_id': '26bc1c0c-1b78-4a7b-a84f-89c50e00950a', 'serial': '26bc1c0c-1b78-4a7b-a84f-89c50e00950a', 'multiattach': True}, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:24:47.581007 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:24:47.583196 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-23888798', uuid='c81257f9-fd45-451e-a71b-680f4c383553'), owner=OwnerMeta(userid='d2494a2c41134b13a25b86d1bdfdd65f', username='tempest-AttachVolumeMultiAttachTest-1495503700-project-member', projectid='4a07dd99b19249acb501695a25608424', projectname='tempest-AttachVolumeMultiAttachTest-1495503700'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7882b9a2-4014-4950-b3f8-9ed20ce7a9d5", "address": "fa:16:3e:27:9a:3d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7882b9a2-40", "ovs_interfaceid": "7882b9a2-4014-4950-b3f8-9ed20ce7a9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769473487.582418) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:24:47.585427 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:24:47.586307 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:24:47.588049 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:24:47.588691 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:24:47.590315 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:24:47.590941 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:24:47.591332 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:24:47.591622 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:24:47.592114 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:24:47.592387 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:24:47.592654 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:24:47.593060 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:24:47.593348 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:24:47.593686 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:24:47.594023 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:24:47.594340 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:24:47.599147 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Calling os-brick to attach iSCSI Volume {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jan 26 19:24:47.600316 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a', 'target_lun': 0, 'volume_id': '26bc1c0c-1b78-4a7b-a84f-89c50e00950a', 'auth_method': 'CHAP', 'auth_username': '8tk84jfYMxaDptvxyHCD', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:24:47.600620 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:24:47.601292 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:24:47.601608 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a', 'target_lun': 0, 'volume_id': '26bc1c0c-1b78-4a7b-a84f-89c50e00950a', 'auth_method': 'CHAP', 'auth_username': '8tk84jfYMxaDptvxyHCD', 'auth_password': 'AzAAwqFVC452aqtN', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True} {{(pid=189076) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:24:47.602941 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:47.610052 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:24:47.613044 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[0891d19f-5fa0-435a-a6a3-8a950de5d0a2]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:24:47.613044 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:24:47.613044 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:24:47.613044 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:24:47.613044 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:24:47.613044 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:24:47.613044 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:24:47.613044 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:24:47.613044 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:24:47.613044 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:24:47.613044 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:24:47.613044 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:24:47.613044 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:24:47.613044 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:24:47.613044 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:24:47.613044 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:24:47.613044 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:24:47.613044 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:24:47.613044 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:24:47.613044 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:24:47.613044 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:24:47.613044 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:24:47.615568 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[0891d19f-5fa0-435a-a6a3-8a950de5d0a2]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:47.616665 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:24:47.617490 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:24:47.618009 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:24:47.619700 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:47.629387 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260" returned: 21 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:47.629930 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ad5b20-8287-411d-88c9-6a8460964abd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:47.630316 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:24:47.630316 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:24:47.631311 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260 --interface default --op new {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:47.641610 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:47.641987 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0ba102-9d6f-4813-8fa3-ef0e1ee331e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:47.642209 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a] added Jan 26 19:24:47.642209 np0005596550.novalocal nova-compute[189076]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:24:47.642209 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:24:47.642209 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:24:47.642209 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:24:47.642367 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=189076) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:24:47.642639 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.025(s), this was the 1st time calling it. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:24:47.642901 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:24:48.644065 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:24:48.645014 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:48.652832 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:48.653061 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbd36f7-670e-4db0-b827-3e319d4f0618]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.name = iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.tpgt = -1 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.startup = automatic Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.leading_login = No Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.iscsi_ifacename = default Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.net_ifacename = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.ipaddress = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.prefix_len = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.hwaddress = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.transport_name = tcp Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.initiatorname = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.state = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.vlan_id = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.vlan_priority = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.vlan_state = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.iface_num = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.mtu = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.port = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.bootproto = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.subnet_mask = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.gateway = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id_state = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.dhcp_dns = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.dhcp_learn_iqn = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.dhcp_req_vendor_id_state = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id_state = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.dhcp_slp_da = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.fragmentation = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.gratuitous_arp = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.incoming_forwarding = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.tos_state = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.tos = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.ttl = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.delayed_ack = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.tcp_nagle = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf_state = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.tcp_timer_scale = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.tcp_timestamp = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.redirect = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.def_task_mgmt_timeout = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.header_digest = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.data_digest = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.immediate_data = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.initial_r2t = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.data_seq_inorder = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.data_pdu_inorder = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.erl = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.max_receive_data_len = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.first_burst_len = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.max_outstanding_r2t = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.max_burst_len = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.chap_auth = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.bidi_chap = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.strict_login_compliance = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.discovery_auth = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: iface.discovery_logout = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.discovery_address = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.discovery_port = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.discovery_type = fw Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.initial_cmdsn = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.initial_login_retry_max = 8 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.xmit_thread_priority = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.cmds_max = 128 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.queue_depth = 32 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.nr_sessions = 1 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.auth.authmethod = None Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.auth.username = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.auth.password = *** Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.auth.username_in = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.auth.password_in = Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.timeo.replacement_timeout = 120 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FastAbort = Yes Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.InitialR2T = No Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ImmediateData = Yes Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxConnections = 1 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ERL = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.scan = auto Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.reopen_max = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.session.conn_reopen_log_freq = 1 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.conn[0].address = 38.102.83.18 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.conn[0].port = 3260 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.conn[0].startup = manual Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.window_size = 524288 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.DataDigest = None Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.IFMarker = No Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.OFMarker = No Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: # END RECORD Jan 26 19:24:48.654336 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:24:48.655660 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:48.664166 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:48.664352 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[1618ec5b-4753-46da-9dd6-60a91320b409]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:48.664720 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:24:48.665623 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:48.678394 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:48.678572 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a96b68f-e6c7-4976-b307-e8e15fca9cfc]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:48.678999 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:24:48.680890 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260 --op update -n node.session.auth.username -v 8tk84jfYMxaDptvxyHCD {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:48.688528 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260 --op update -n node.session.auth.username -v 8tk84jfYMxaDptvxyHCD" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:48.688854 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dc74d0-c741-4a09-bf58-25b595914a5d]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:48.689194 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', '8tk84jfYMxaDptvxyHCD'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:24:48.690235 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:48.700198 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:48.700445 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[778670b7-e739-4145-b0dc-b1454978415f]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:48.700873 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:24:48.701520 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:48.711201 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:48.711432 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4959f86-8e51-42ab-b9b7-1b48a8bbf2d9]: (4, ('tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:48.711695 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:24:48.711695 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:24:48.711860 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsi session list stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:24:48.711860 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:24:48.712558 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260 --login {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:48.728831 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260 --login" returned: 0 in 0.016s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:48.728981 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[99759438-e3c9-4b2a-b540-6377ae4d7648]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:48.729356 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a, portal: 38.102.83.18,3260] successful. Jan 26 19:24:48.729356 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:24:48.730084 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:48.738932 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:48.739038 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[10faef49-dc56-4032-9bd9-77aed76f9406]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:48.739372 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:24:48.740107 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:48.749687 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:48.749926 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4912e1a-d114-4284-8795-7cdbb38e555f]: (4, ('tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash)\ntcp: [31] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:48.750216 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:24:48.750216 np0005596550.novalocal nova-compute[189076]: tcp: [31] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a (non-flash) Jan 26 19:24:48.750216 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:24:48.750378 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsi session list stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:24:48.750378 np0005596550.novalocal nova-compute[189076]: tcp: [31] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a (non-flash) Jan 26 19:24:48.750378 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:24:48.750685 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.133s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:24:48.750818 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connected to 38.102.83.18:3260 {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:24:48.751238 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] HCTL ('3', '-', '-', 0) found on session 31 with lun 0 {{(pid=189076) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:24:48.751394 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Scanning host 3 c: -, t: -, l: 0) {{(pid=189076) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:24:48.752237 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host3/scan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:48.769401 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host3/scan" returned: 0 in 0.017s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:48.769523 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[182cb4e1-fd47-49e4-9c50-baa5ffb7c263]: (4, ('- - 0', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:48.771113 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching for a device in session 31 and hctl ['3', '*', '*', 0] yield: None {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:24:49.772931 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Searching for a device in session 31 and hctl ['3', '*', '*', 0] yield: sdb {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:24:49.772931 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Connected to sdb using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a', 'target_lun': 0, 'volume_id': '26bc1c0c-1b78-4a7b-a84f-89c50e00950a', 'auth_method': 'CHAP', 'auth_username': '8tk84jfYMxaDptvxyHCD', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True} {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:24:49.773930 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.172s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:24:49.773930 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] <== connect_volume: return (2173ms) {'type': 'block', 'scsi_wwn': '360014056587e563258045bfa6f0beff5', 'path': '/dev/sdb'} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:24:49.774015 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '360014056587e563258045bfa6f0beff5', 'path': '/dev/sdb'} {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jan 26 19:24:50.281677 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-23888798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-attachvolumemultiattachtest-server-23888798',id=106,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-06k3kbxl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:24:41Z,user_data=None,user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=c81257f9-fd45-451e-a71b-680f4c383553,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7882b9a2-4014-4950-b3f8-9ed20ce7a9d5", "address": "fa:16:3e:27:9a:3d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7882b9a2-40", "ovs_interfaceid": "7882b9a2-4014-4950-b3f8-9ed20ce7a9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:24:50.282010 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "7882b9a2-4014-4950-b3f8-9ed20ce7a9d5", "address": "fa:16:3e:27:9a:3d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7882b9a2-40", "ovs_interfaceid": "7882b9a2-4014-4950-b3f8-9ed20ce7a9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:24:50.282358 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:9a:3d,bridge_name='br-int',has_traffic_filtering=True,id=7882b9a2-4014-4950-b3f8-9ed20ce7a9d5,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7882b9a2-40') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:24:50.282881 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'pci_devices' on Instance uuid c81257f9-fd45-451e-a71b-680f4c383553 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] End _get_guest_xml xml= Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: c81257f9-fd45-451e-a71b-680f4c383553 Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: instance-0000006a Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: tempest-AttachVolumeMultiAttachTest-server-23888798 Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:24:47 Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: tempest-AttachVolumeMultiAttachTest-1495503700-project-member Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: tempest-AttachVolumeMultiAttachTest-1495503700 Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: c81257f9-fd45-451e-a71b-680f4c383553 Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: c81257f9-fd45-451e-a71b-680f4c383553 Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: 26bc1c0c-1b78-4a7b-a84f-89c50e00950a Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: Jan 26 19:24:50.786179 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:24:50.789098 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Preparing to wait for external event network-vif-plugged-7882b9a2-4014-4950-b3f8-9ed20ce7a9d5 {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:24:50.789098 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "c81257f9-fd45-451e-a71b-680f4c383553-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:24:50.789098 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "c81257f9-fd45-451e-a71b-680f4c383553-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:24:50.789098 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "c81257f9-fd45-451e-a71b-680f4c383553-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:24:50.789098 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-23888798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-attachvolumemultiattachtest-server-23888798',id=106,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-06k3kbxl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:24:41Z,user_data=None,user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=c81257f9-fd45-451e-a71b-680f4c383553,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7882b9a2-4014-4950-b3f8-9ed20ce7a9d5", "address": "fa:16:3e:27:9a:3d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7882b9a2-40", "ovs_interfaceid": "7882b9a2-4014-4950-b3f8-9ed20ce7a9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:24:50.789404 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "7882b9a2-4014-4950-b3f8-9ed20ce7a9d5", "address": "fa:16:3e:27:9a:3d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7882b9a2-40", "ovs_interfaceid": "7882b9a2-4014-4950-b3f8-9ed20ce7a9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:24:50.789404 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:9a:3d,bridge_name='br-int',has_traffic_filtering=True,id=7882b9a2-4014-4950-b3f8-9ed20ce7a9d5,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7882b9a2-40') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:24:50.789404 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9a:3d,bridge_name='br-int',has_traffic_filtering=True,id=7882b9a2-4014-4950-b3f8-9ed20ce7a9d5,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7882b9a2-40') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:24:50.789852 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:50.790203 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:24:50.790552 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:24:50.791656 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:50.791978 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0882b036-0ce4-58aa-8108-42fd933d26de', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:24:50.824318 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:50.826874 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:24:50.829110 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:50.829340 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7882b9a2-40, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:24:50.829743 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7882b9a2-40, col_values=(('qos', UUID('24949569-f176-4f37-904f-551c8207b662')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:24:50.830033 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7882b9a2-40, col_values=(('external_ids', {'iface-id': '7882b9a2-4014-4950-b3f8-9ed20ce7a9d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:9a:3d', 'vm-uuid': 'c81257f9-fd45-451e-a71b-680f4c383553'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:24:50.831108 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:50.833794 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:24:50.837870 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:50.839253 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9a:3d,bridge_name='br-int',has_traffic_filtering=True,id=7882b9a2-4014-4950-b3f8-9ed20ce7a9d5,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7882b9a2-40') Jan 26 19:24:52.367000 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:24:52.367402 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:24:52.367402 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] No VIF found with MAC fa:16:3e:27:9a:3d, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:24:52.367844 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Using config drive Jan 26 19:24:52.874061 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:24:52.957859 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Creating config drive at /opt/stack/data/nova/instances/c81257f9-fd45-451e-a71b-680f4c383553/disk.config Jan 26 19:24:52.962541 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/c81257f9-fd45-451e-a71b-680f4c383553/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp16znsg0r {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:53.087795 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/c81257f9-fd45-451e-a71b-680f4c383553/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp16znsg0r" returned: 0 in 0.125s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:53.208716 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:53.217230 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:53.343842 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:53.345303 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:53.357238 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d0b01984-994d-43ea-b6fd-5e2a1ea33aee req-94e24f41-ef0a-428f-b170-2ad42f90a47b service nova] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Received event network-vif-plugged-7882b9a2-4014-4950-b3f8-9ed20ce7a9d5 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:24:53.357471 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d0b01984-994d-43ea-b6fd-5e2a1ea33aee req-94e24f41-ef0a-428f-b170-2ad42f90a47b service nova] Acquiring lock "c81257f9-fd45-451e-a71b-680f4c383553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:24:53.357709 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d0b01984-994d-43ea-b6fd-5e2a1ea33aee req-94e24f41-ef0a-428f-b170-2ad42f90a47b service nova] Lock "c81257f9-fd45-451e-a71b-680f4c383553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:24:53.358037 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-d0b01984-994d-43ea-b6fd-5e2a1ea33aee req-94e24f41-ef0a-428f-b170-2ad42f90a47b service nova] Lock "c81257f9-fd45-451e-a71b-680f4c383553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:24:53.358204 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-d0b01984-994d-43ea-b6fd-5e2a1ea33aee req-94e24f41-ef0a-428f-b170-2ad42f90a47b service nova] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Processing event network-vif-plugged-7882b9a2-4014-4950-b3f8-9ed20ce7a9d5 {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:24:53.391409 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:24:53.391882 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c81257f9-fd45-451e-a71b-680f4c383553] VM Started (Lifecycle Event) Jan 26 19:24:53.393080 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:24:53.397794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:24:53.397794 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Instance spawned successfully. Jan 26 19:24:53.397794 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:24:53.518755 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:53.895422 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:24:53.904726 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:24:53.909097 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:24:53.909515 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:24:53.910374 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:24:53.911173 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:24:53.911882 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:24:53.912875 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:24:54.419462 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c81257f9-fd45-451e-a71b-680f4c383553] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:24:54.419893 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:24:54.419893 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c81257f9-fd45-451e-a71b-680f4c383553] VM Paused (Lifecycle Event) Jan 26 19:24:54.421713 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Took 6.85 seconds to spawn the instance on the hypervisor. Jan 26 19:24:54.421930 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:24:54.896041 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:24:54.896236 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Cleaning up deleted instances with incomplete migration {{(pid=189076) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11998}} Jan 26 19:24:54.923918 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:24:54.926906 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:24:54.927114 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c81257f9-fd45-451e-a71b-680f4c383553] VM Resumed (Lifecycle Event) Jan 26 19:24:54.933544 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Took 17.81 seconds to build instance. Jan 26 19:24:55.383755 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b3ef2bb8-dfaf-4a20-b14c-f2c7574c20b9 req-ef0fafea-ea84-4f2b-bc5b-b39930571dbf service nova] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Received event network-vif-plugged-7882b9a2-4014-4950-b3f8-9ed20ce7a9d5 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:24:55.383755 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b3ef2bb8-dfaf-4a20-b14c-f2c7574c20b9 req-ef0fafea-ea84-4f2b-bc5b-b39930571dbf service nova] Acquiring lock "c81257f9-fd45-451e-a71b-680f4c383553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:24:55.383755 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b3ef2bb8-dfaf-4a20-b14c-f2c7574c20b9 req-ef0fafea-ea84-4f2b-bc5b-b39930571dbf service nova] Lock "c81257f9-fd45-451e-a71b-680f4c383553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:24:55.383755 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-b3ef2bb8-dfaf-4a20-b14c-f2c7574c20b9 req-ef0fafea-ea84-4f2b-bc5b-b39930571dbf service nova] Lock "c81257f9-fd45-451e-a71b-680f4c383553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:24:55.383755 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-b3ef2bb8-dfaf-4a20-b14c-f2c7574c20b9 req-ef0fafea-ea84-4f2b-bc5b-b39930571dbf service nova] [instance: c81257f9-fd45-451e-a71b-680f4c383553] No waiting events found dispatching network-vif-plugged-7882b9a2-4014-4950-b3f8-9ed20ce7a9d5 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:24:55.384017 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-b3ef2bb8-dfaf-4a20-b14c-f2c7574c20b9 req-ef0fafea-ea84-4f2b-bc5b-b39930571dbf service nova] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Received unexpected event network-vif-plugged-7882b9a2-4014-4950-b3f8-9ed20ce7a9d5 for instance with vm_state active and task_state None. Jan 26 19:24:55.430074 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:24:55.435704 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-b5713376-f4da-45e3-814a-148f596b072c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "c81257f9-fd45-451e-a71b-680f4c383553" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.324s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:24:55.436758 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:24:55.877014 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:58.369175 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "c81257f9-fd45-451e-a71b-680f4c383553" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:24:58.369688 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "c81257f9-fd45-451e-a71b-680f4c383553" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:24:58.369902 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "c81257f9-fd45-451e-a71b-680f4c383553-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:24:58.370227 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "c81257f9-fd45-451e-a71b-680f4c383553-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:24:58.370535 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "c81257f9-fd45-451e-a71b-680f4c383553-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:24:58.374139 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Terminating instance Jan 26 19:24:58.879710 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:24:58.901006 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:58.903021 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:58.903822 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:59.021095 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-bd6f4c34-4a26-4283-bd04-4243dea9dde1 req-f4d93d04-47f2-4d85-9fb2-b2a60daf807c service nova] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Received event network-vif-unplugged-7882b9a2-4014-4950-b3f8-9ed20ce7a9d5 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:24:59.021095 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-bd6f4c34-4a26-4283-bd04-4243dea9dde1 req-f4d93d04-47f2-4d85-9fb2-b2a60daf807c service nova] Acquiring lock "c81257f9-fd45-451e-a71b-680f4c383553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:24:59.021095 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-bd6f4c34-4a26-4283-bd04-4243dea9dde1 req-f4d93d04-47f2-4d85-9fb2-b2a60daf807c service nova] Lock "c81257f9-fd45-451e-a71b-680f4c383553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:24:59.021095 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-bd6f4c34-4a26-4283-bd04-4243dea9dde1 req-f4d93d04-47f2-4d85-9fb2-b2a60daf807c service nova] Lock "c81257f9-fd45-451e-a71b-680f4c383553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:24:59.021095 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-bd6f4c34-4a26-4283-bd04-4243dea9dde1 req-f4d93d04-47f2-4d85-9fb2-b2a60daf807c service nova] [instance: c81257f9-fd45-451e-a71b-680f4c383553] No waiting events found dispatching network-vif-unplugged-7882b9a2-4014-4950-b3f8-9ed20ce7a9d5 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:24:59.021095 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-bd6f4c34-4a26-4283-bd04-4243dea9dde1 req-f4d93d04-47f2-4d85-9fb2-b2a60daf807c service nova] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Received event network-vif-unplugged-7882b9a2-4014-4950-b3f8-9ed20ce7a9d5 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:24:59.030390 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:59.035915 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:59.176312 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Instance destroyed successfully. Jan 26 19:24:59.176681 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'resources' on Instance uuid c81257f9-fd45-451e-a71b-680f4c383553 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:24:59.681334 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-23888798',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-attachvolumemultiattachtest-server-23888798',id=106,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:24:54Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-06k3kbxl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:24:54Z,user_data=None,user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=c81257f9-fd45-451e-a71b-680f4c383553,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7882b9a2-4014-4950-b3f8-9ed20ce7a9d5", "address": "fa:16:3e:27:9a:3d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7882b9a2-40", "ovs_interfaceid": "7882b9a2-4014-4950-b3f8-9ed20ce7a9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:24:59.681871 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "7882b9a2-4014-4950-b3f8-9ed20ce7a9d5", "address": "fa:16:3e:27:9a:3d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7882b9a2-40", "ovs_interfaceid": "7882b9a2-4014-4950-b3f8-9ed20ce7a9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:24:59.683029 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:9a:3d,bridge_name='br-int',has_traffic_filtering=True,id=7882b9a2-4014-4950-b3f8-9ed20ce7a9d5,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7882b9a2-40') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:24:59.683616 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9a:3d,bridge_name='br-int',has_traffic_filtering=True,id=7882b9a2-4014-4950-b3f8-9ed20ce7a9d5,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7882b9a2-40') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:24:59.685954 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:59.686404 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7882b9a2-40, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:24:59.735064 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:59.739256 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:24:59.740532 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:59.741020 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=24949569-f176-4f37-904f-551c8207b662) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:24:59.741930 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:59.743068 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:24:59.746455 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9a:3d,bridge_name='br-int',has_traffic_filtering=True,id=7882b9a2-4014-4950-b3f8-9ed20ce7a9d5,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7882b9a2-40') Jan 26 19:24:59.783087 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] calling os-brick to detach iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jan 26 19:24:59.783920 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a', 'target_lun': 0, 'volume_id': '26bc1c0c-1b78-4a7b-a84f-89c50e00950a', 'auth_method': 'CHAP', 'auth_username': '8tk84jfYMxaDptvxyHCD', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:24:59.784148 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:24:59.784692 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:24:59.787538 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:59.796129 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:59.796305 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[6572b2f3-f390-43e6-8374-61ad28ef0c05]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:59.796692 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:24:59.796692 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:24:59.796692 np0005596550.novalocal nova-compute[189076]: iSNS: Jan 26 19:24:59.796692 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:24:59.796692 np0005596550.novalocal nova-compute[189076]: STATIC: Jan 26 19:24:59.796692 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 Jan 26 19:24:59.796692 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:24:59.796692 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:24:59.796692 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a Jan 26 19:24:59.796692 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:24:59.796692 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:24:59.796692 np0005596550.novalocal nova-compute[189076]: FIRMWARE: Jan 26 19:24:59.796692 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:24:59.796692 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:24:59.798797 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:24:59.798797 np0005596550.novalocal nova-compute[189076]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:24:59.798797 np0005596550.novalocal nova-compute[189076]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=189076) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:24:59.798797 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a', 0)] {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:24:59.798797 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:59.809258 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:59.809386 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dda1825-f2e6-4141-a822-5c1e14d6df50]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a\n38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:59.810115 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:59.819059 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:59.819161 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2debe6-e38b-4808-9a34-d6722c0f8fb5]: (4, ('tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash)\ntcp: [31] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:59.819459 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:24:59.819459 np0005596550.novalocal nova-compute[189076]: tcp: [31] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a (non-flash) Jan 26 19:24:59.819459 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:24:59.819646 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsi session list stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:24:59.819646 np0005596550.novalocal nova-compute[189076]: tcp: [31] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a (non-flash) Jan 26 19:24:59.819646 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:24:59.820192 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Resulting device map defaultdict(. at 0x7fd72c311080>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a'): ({'sdb'}, set())}) {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:24:59.820408 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Removing single pathed devices sdb {{(pid=189076) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:24:59.821115 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:59.825977 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:24:59.827553 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[c65f4b88-cbc7-4d08-af80-208f77a25d6f]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:24:59.827553 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:24:59.827553 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:24:59.827553 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:24:59.827553 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:24:59.827553 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:24:59.827553 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:24:59.827553 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:24:59.827553 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:24:59.827553 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:24:59.827553 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:24:59.827553 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:24:59.827553 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:24:59.827553 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:24:59.827553 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:24:59.827553 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:24:59.827553 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:24:59.827553 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:24:59.827553 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:24:59.827553 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:24:59.827553 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:24:59.827553 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:24:59.828106 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65f4b88-cbc7-4d08-af80-208f77a25d6f]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:59.828833 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Flushing IO for device /dev/sdb {{(pid=189076) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:24:59.829531 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:59.835406 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.006s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:59.835645 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bea2d2-700e-4c3d-9023-b6b80c08a48e]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:59.835959 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=189076) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:24:59.836481 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:59.891287 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:59.891414 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[826f2925-5619-45d5-92a5-a9f590a8c322]: (4, ('1', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:59.891714 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:24:59.891913 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] SCSI volumes sdb have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:24:59.892250 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a')] {{(pid=189076) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:24:59.893065 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:59.902425 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:59.902516 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacfbf57-fb05-473b-a9bf-55f69a7e98b5]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:59.902847 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:24:59.903560 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260 --logout {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:59.931749 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260 --logout" returned: 0 in 0.028s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:59.931896 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d226a8b8-1f5d-46a9-9e3b-4a56e406398e]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a, portal: 38.102.83.18,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:59.932208 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a, portal: 38.102.83.18,3260] Jan 26 19:24:59.932208 np0005596550.novalocal nova-compute[189076]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a, portal: 38.102.83.18,3260] successful. Jan 26 19:24:59.932208 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:24:59.932920 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260 --op delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:24:59.943125 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26bc1c0c-1b78-4a7b-a84f-89c50e00950a -p 38.102.83.18:3260 --op delete" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:24:59.943241 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3c2ab6-fc11-447e-8763-0dfe8479bb74]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:24:59.943571 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:24:59.943843 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.159s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:24:59.943983 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] <== disconnect_volume: return (160ms) None {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:24:59.944120 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Disconnected iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jan 26 19:24:59.944370 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Deleting instance files /opt/stack/data/nova/instances/c81257f9-fd45-451e-a71b-680f4c383553_del Jan 26 19:24:59.944745 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Deletion of /opt/stack/data/nova/instances/c81257f9-fd45-451e-a71b-680f4c383553_del complete Jan 26 19:25:00.450918 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Took 1.57 seconds to destroy the instance on the hypervisor. Jan 26 19:25:00.451180 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:25:00.451548 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:25:00.451654 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: c81257f9-fd45-451e-a71b-680f4c383553] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:25:00.451914 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:25:00.495549 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:25:01.062450 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a12dbaac-9611-4e5e-95d5-e936cf7f923b req-fb6943db-512f-4b52-9ad6-e360a7b0cbcf service nova] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Received event network-vif-unplugged-7882b9a2-4014-4950-b3f8-9ed20ce7a9d5 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:25:01.063493 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a12dbaac-9611-4e5e-95d5-e936cf7f923b req-fb6943db-512f-4b52-9ad6-e360a7b0cbcf service nova] Acquiring lock "c81257f9-fd45-451e-a71b-680f4c383553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:01.063493 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a12dbaac-9611-4e5e-95d5-e936cf7f923b req-fb6943db-512f-4b52-9ad6-e360a7b0cbcf service nova] Lock "c81257f9-fd45-451e-a71b-680f4c383553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:01.063493 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a12dbaac-9611-4e5e-95d5-e936cf7f923b req-fb6943db-512f-4b52-9ad6-e360a7b0cbcf service nova] Lock "c81257f9-fd45-451e-a71b-680f4c383553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:01.063493 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a12dbaac-9611-4e5e-95d5-e936cf7f923b req-fb6943db-512f-4b52-9ad6-e360a7b0cbcf service nova] [instance: c81257f9-fd45-451e-a71b-680f4c383553] No waiting events found dispatching network-vif-unplugged-7882b9a2-4014-4950-b3f8-9ed20ce7a9d5 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:25:01.063493 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a12dbaac-9611-4e5e-95d5-e936cf7f923b req-fb6943db-512f-4b52-9ad6-e360a7b0cbcf service nova] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Received event network-vif-unplugged-7882b9a2-4014-4950-b3f8-9ed20ce7a9d5 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:25:01.063664 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a12dbaac-9611-4e5e-95d5-e936cf7f923b req-fb6943db-512f-4b52-9ad6-e360a7b0cbcf service nova] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Received event network-vif-deleted-7882b9a2-4014-4950-b3f8-9ed20ce7a9d5 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:25:01.063865 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-a12dbaac-9611-4e5e-95d5-e936cf7f923b req-fb6943db-512f-4b52-9ad6-e360a7b0cbcf service nova] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Neutron deleted interface 7882b9a2-4014-4950-b3f8-9ed20ce7a9d5; detaching it from the instance and deleting it from the info cache Jan 26 19:25:01.064035 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-a12dbaac-9611-4e5e-95d5-e936cf7f923b req-fb6943db-512f-4b52-9ad6-e360a7b0cbcf service nova] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:25:01.285421 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:25:01.569262 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a12dbaac-9611-4e5e-95d5-e936cf7f923b req-fb6943db-512f-4b52-9ad6-e360a7b0cbcf service nova] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Detach interface failed, port_id=7882b9a2-4014-4950-b3f8-9ed20ce7a9d5, reason: Instance c81257f9-fd45-451e-a71b-680f4c383553 could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:25:01.788260 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Took 1.34 seconds to deallocate network for instance. Jan 26 19:25:04.742607 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:04.899529 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Took 3.11 seconds to detach 1 volumes for instance. Jan 26 19:25:05.409722 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:05.409937 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:05.668055 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:25:06.172221 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:25:06.679652 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.269s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:06.740488 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Deleted allocations for instance c81257f9-fd45-451e-a71b-680f4c383553 Jan 26 19:25:07.751491 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-cdef7d44-fb4a-4cbc-8653-61c66e136a07 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "c81257f9-fd45-451e-a71b-680f4c383553" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 9.382s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:09.744580 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:25:09.745965 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:25:09.746067 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:25:09.746152 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:25:09.776005 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:09.776264 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:25:14.174289 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:25:14.174969 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: c81257f9-fd45-451e-a71b-680f4c383553] VM Stopped (Lifecycle Event) Jan 26 19:25:14.677990 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-56c11a8f-4d91-4243-82f2-cc631359119c None None] [instance: c81257f9-fd45-451e-a71b-680f4c383553] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:25:14.777472 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:25:14.778932 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:25:14.779056 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:25:14.779153 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:25:14.815197 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:14.815483 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:25:16.033996 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "03068296-12d4-4dbe-9770-c070e336a3bf" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:16.033996 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "03068296-12d4-4dbe-9770-c070e336a3bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:16.033996 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:16.033996 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:16.033996 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:16.036064 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Terminating instance Jan 26 19:25:16.540830 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:25:16.572851 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:16.713930 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:16.722559 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:16.727483 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-bd59f539-ff2f-49e5-84c3-d464c3768956 req-1fd6c1e1-e0fa-44c6-b26e-413e63a784f9 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Received event network-vif-unplugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:25:16.727850 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-bd59f539-ff2f-49e5-84c3-d464c3768956 req-1fd6c1e1-e0fa-44c6-b26e-413e63a784f9 service nova] Acquiring lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:16.728170 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-bd59f539-ff2f-49e5-84c3-d464c3768956 req-1fd6c1e1-e0fa-44c6-b26e-413e63a784f9 service nova] Lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:16.728452 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-bd59f539-ff2f-49e5-84c3-d464c3768956 req-1fd6c1e1-e0fa-44c6-b26e-413e63a784f9 service nova] Lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:16.728732 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-bd59f539-ff2f-49e5-84c3-d464c3768956 req-1fd6c1e1-e0fa-44c6-b26e-413e63a784f9 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] No waiting events found dispatching network-vif-unplugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:25:16.729568 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-bd59f539-ff2f-49e5-84c3-d464c3768956 req-1fd6c1e1-e0fa-44c6-b26e-413e63a784f9 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Received event network-vif-unplugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:25:16.773431 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:16.786093 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:16.830300 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Instance destroyed successfully. Jan 26 19:25:16.830721 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'resources' on Instance uuid 03068296-12d4-4dbe-9770-c070e336a3bf {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:25:17.334150 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:22:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='multiattach-server-1',id=105,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2DqNsC6gMM/rMUhFP33wutEbCJfSUZoLXi4knAQI7cL83VCjf4w8Ol5UVNVyCMMM4G5N6GoZa1daASRvj6YYLKi4Cz6e/HnHlp1PtG4CCeiOBWtfpou2xsaXI9ivoyQw==',key_name='tempest-keypair-1141931557',keypairs=,launch_index=0,launched_at=2026-01-27T00:23:58Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-yxpzl051',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:24:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=03068296-12d4-4dbe-9770-c070e336a3bf,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:25:17.335060 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "address": "fa:16:3e:64:65:1e", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0932d0a-9e", "ovs_interfaceid": "c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:25:17.335060 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:65:1e,bridge_name='br-int',has_traffic_filtering=True,id=c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0932d0a-9e') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:25:17.335265 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:65:1e,bridge_name='br-int',has_traffic_filtering=True,id=c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0932d0a-9e') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:25:17.337118 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:17.337358 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0932d0a-9e, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:25:17.380637 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:17.382702 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:17.383694 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:17.383946 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5cf323e-d0b9-4b14-8806-a0aa9b15951a) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:25:17.384633 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:17.386639 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:25:17.386923 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:17.389867 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:65:1e,bridge_name='br-int',has_traffic_filtering=True,id=c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0932d0a-9e') Jan 26 19:25:17.390217 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Deleting instance files /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf_del Jan 26 19:25:17.390810 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Deletion of /opt/stack/data/nova/instances/03068296-12d4-4dbe-9770-c070e336a3bf_del complete Jan 26 19:25:17.902834 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Took 1.36 seconds to destroy the instance on the hypervisor. Jan 26 19:25:17.902834 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:25:17.902834 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:25:17.902834 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:25:17.903096 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:25:17.996048 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:25:18.790913 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-bdcc3752-c2c0-422f-8728-79bd243d0de1 req-29e70a1c-248f-4932-ae40-e45c11a6b8a3 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Received event network-vif-unplugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:25:18.791333 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-bdcc3752-c2c0-422f-8728-79bd243d0de1 req-29e70a1c-248f-4932-ae40-e45c11a6b8a3 service nova] Acquiring lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:18.791333 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-bdcc3752-c2c0-422f-8728-79bd243d0de1 req-29e70a1c-248f-4932-ae40-e45c11a6b8a3 service nova] Lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:18.791501 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-bdcc3752-c2c0-422f-8728-79bd243d0de1 req-29e70a1c-248f-4932-ae40-e45c11a6b8a3 service nova] Lock "03068296-12d4-4dbe-9770-c070e336a3bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:18.791676 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-bdcc3752-c2c0-422f-8728-79bd243d0de1 req-29e70a1c-248f-4932-ae40-e45c11a6b8a3 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] No waiting events found dispatching network-vif-unplugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:25:18.791986 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-bdcc3752-c2c0-422f-8728-79bd243d0de1 req-29e70a1c-248f-4932-ae40-e45c11a6b8a3 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Received event network-vif-unplugged-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:25:18.792547 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-bdcc3752-c2c0-422f-8728-79bd243d0de1 req-29e70a1c-248f-4932-ae40-e45c11a6b8a3 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Received event network-vif-deleted-c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:25:18.792547 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-bdcc3752-c2c0-422f-8728-79bd243d0de1 req-29e70a1c-248f-4932-ae40-e45c11a6b8a3 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Neutron deleted interface c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f; detaching it from the instance and deleting it from the info cache Jan 26 19:25:18.792610 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-bdcc3752-c2c0-422f-8728-79bd243d0de1 req-29e70a1c-248f-4932-ae40-e45c11a6b8a3 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:25:18.923814 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:25:19.298692 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-bdcc3752-c2c0-422f-8728-79bd243d0de1 req-29e70a1c-248f-4932-ae40-e45c11a6b8a3 service nova] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Detach interface failed, port_id=c0932d0a-9e23-4fb2-a4c9-0ddaf9ff7c2f, reason: Instance 03068296-12d4-4dbe-9770-c070e336a3bf could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:25:19.427042 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Took 1.52 seconds to deallocate network for instance. Jan 26 19:25:19.935239 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:19.936015 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:20.125018 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:25:20.629216 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:25:21.137854 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.202s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:21.432032 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Deleted allocations for instance 03068296-12d4-4dbe-9770-c070e336a3bf Jan 26 19:25:22.388741 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:25:22.390374 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:25:22.390565 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:25:22.390739 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:25:22.438655 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:22.439145 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:25:22.948683 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-4cd1e04f-5cc9-4789-b311-8637d3f109d7 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "03068296-12d4-4dbe-9770-c070e336a3bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.916s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:24.359824 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "7985cac9-68f6-40e7-bb90-7761b4220db7" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:24.360455 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:24.360546 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:24.360908 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:24.361210 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:24.364400 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Terminating instance Jan 26 19:25:24.870326 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:25:24.952253 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:25.094490 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:25.102928 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:25.102928 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:25.111225 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:25.120905 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ec729934-90a2-46e7-914f-63f185de40c5 req-1bf1b4d2-4fc6-48ce-8467-5a80f166e87a service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Received event network-vif-unplugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:25:25.121122 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ec729934-90a2-46e7-914f-63f185de40c5 req-1bf1b4d2-4fc6-48ce-8467-5a80f166e87a service nova] Acquiring lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:25.121439 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ec729934-90a2-46e7-914f-63f185de40c5 req-1bf1b4d2-4fc6-48ce-8467-5a80f166e87a service nova] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:25.121578 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ec729934-90a2-46e7-914f-63f185de40c5 req-1bf1b4d2-4fc6-48ce-8467-5a80f166e87a service nova] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:25.121825 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ec729934-90a2-46e7-914f-63f185de40c5 req-1bf1b4d2-4fc6-48ce-8467-5a80f166e87a service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] No waiting events found dispatching network-vif-unplugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:25:25.122261 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ec729934-90a2-46e7-914f-63f185de40c5 req-1bf1b4d2-4fc6-48ce-8467-5a80f166e87a service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Received event network-vif-unplugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:25:25.136817 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Instance destroyed successfully. Jan 26 19:25:25.137133 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'resources' on Instance uuid 7985cac9-68f6-40e7-bb90-7761b4220db7 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:25:25.640861 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:21:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0005596550.novalocal',hostname='multiattach-server-0',id=104,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2DqNsC6gMM/rMUhFP33wutEbCJfSUZoLXi4knAQI7cL83VCjf4w8Ol5UVNVyCMMM4G5N6GoZa1daASRvj6YYLKi4Cz6e/HnHlp1PtG4CCeiOBWtfpou2xsaXI9ivoyQw==',key_name='tempest-keypair-1141931557',keypairs=,launch_index=0,launched_at=2026-01-27T00:23:14Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-1796nvkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=7985cac9-68f6-40e7-bb90-7761b4220db7,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:25:25.641970 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "address": "fa:16:3e:9a:38:7d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a61c5d0-be", "ovs_interfaceid": "2a61c5d0-be1d-4c00-9d7b-8854ff697d7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:25:25.642517 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:38:7d,bridge_name='br-int',has_traffic_filtering=True,id=2a61c5d0-be1d-4c00-9d7b-8854ff697d7f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a61c5d0-be') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:25:25.642749 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:38:7d,bridge_name='br-int',has_traffic_filtering=True,id=2a61c5d0-be1d-4c00-9d7b-8854ff697d7f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a61c5d0-be') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:25:25.643720 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:25.643986 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a61c5d0-be, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:25:25.645201 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:25.646996 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:25:25.647658 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:25.647839 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb8a2a06-d775-4f4e-bdaa-cbc046d5d635) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:25:25.648290 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:25.649837 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:25.651635 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:38:7d,bridge_name='br-int',has_traffic_filtering=True,id=2a61c5d0-be1d-4c00-9d7b-8854ff697d7f,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a61c5d0-be') Jan 26 19:25:25.651940 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Deleting instance files /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7_del Jan 26 19:25:25.652300 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Deletion of /opt/stack/data/nova/instances/7985cac9-68f6-40e7-bb90-7761b4220db7_del complete Jan 26 19:25:26.161541 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Took 1.29 seconds to destroy the instance on the hypervisor. Jan 26 19:25:26.162189 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:25:26.162247 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:25:26.162342 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:25:26.162663 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:25:26.290618 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:25:27.078291 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:25:27.172017 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3464e1d1-284d-4ba9-b81c-6d67e148486a req-7c24bafd-050c-4660-983e-f0a7e59b0fec service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Received event network-vif-unplugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:25:27.172476 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3464e1d1-284d-4ba9-b81c-6d67e148486a req-7c24bafd-050c-4660-983e-f0a7e59b0fec service nova] Acquiring lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:27.172811 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3464e1d1-284d-4ba9-b81c-6d67e148486a req-7c24bafd-050c-4660-983e-f0a7e59b0fec service nova] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:27.173882 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3464e1d1-284d-4ba9-b81c-6d67e148486a req-7c24bafd-050c-4660-983e-f0a7e59b0fec service nova] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:27.174029 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3464e1d1-284d-4ba9-b81c-6d67e148486a req-7c24bafd-050c-4660-983e-f0a7e59b0fec service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] No waiting events found dispatching network-vif-unplugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:25:27.174438 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3464e1d1-284d-4ba9-b81c-6d67e148486a req-7c24bafd-050c-4660-983e-f0a7e59b0fec service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Received event network-vif-unplugged-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:25:27.174755 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3464e1d1-284d-4ba9-b81c-6d67e148486a req-7c24bafd-050c-4660-983e-f0a7e59b0fec service nova] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Received event network-vif-deleted-2a61c5d0-be1d-4c00-9d7b-8854ff697d7f {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:25:27.398968 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:25:27.582207 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Took 1.42 seconds to deallocate network for instance. Jan 26 19:25:28.089241 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:28.091146 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:28.225071 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:25:28.728568 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:25:29.235017 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.145s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:29.272151 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Deleted allocations for instance 7985cac9-68f6-40e7-bb90-7761b4220db7 Jan 26 19:25:30.283261 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b78316-1bac-4a5c-8936-1387ff28814b tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "7985cac9-68f6-40e7-bb90-7761b4220db7" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 5.923s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:30.649827 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:31.824176 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:25:31.825002 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] VM Stopped (Lifecycle Event) Jan 26 19:25:32.328160 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-17c09cfc-b11a-457a-baac-40464f676ef4 None None] [instance: 03068296-12d4-4dbe-9770-c070e336a3bf] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:25:33.758413 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "28db8142-2f27-4207-923f-f2f525867805" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:33.758795 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "28db8142-2f27-4207-923f-f2f525867805" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:33.758921 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "28db8142-2f27-4207-923f-f2f525867805-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:33.759481 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "28db8142-2f27-4207-923f-f2f525867805-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:33.759741 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "28db8142-2f27-4207-923f-f2f525867805-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:33.763355 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Terminating instance Jan 26 19:25:33.896313 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:25:34.267639 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:25:34.289747 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:34.407891 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:34.408063 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:34.408278 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:34.408434 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:25:34.409910 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:34.413731 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ebe6abc8-441d-46c1-8110-6a7e70b10377 req-d5de3ae6-0efa-431a-b8e7-bb8bae472a16 service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Received event network-vif-unplugged-de19b0bb-1a2b-4b91-a960-201573fd49dd {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:25:34.414257 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ebe6abc8-441d-46c1-8110-6a7e70b10377 req-d5de3ae6-0efa-431a-b8e7-bb8bae472a16 service nova] Acquiring lock "28db8142-2f27-4207-923f-f2f525867805-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:34.414429 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ebe6abc8-441d-46c1-8110-6a7e70b10377 req-d5de3ae6-0efa-431a-b8e7-bb8bae472a16 service nova] Lock "28db8142-2f27-4207-923f-f2f525867805-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:34.414711 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ebe6abc8-441d-46c1-8110-6a7e70b10377 req-d5de3ae6-0efa-431a-b8e7-bb8bae472a16 service nova] Lock "28db8142-2f27-4207-923f-f2f525867805-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:34.415069 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ebe6abc8-441d-46c1-8110-6a7e70b10377 req-d5de3ae6-0efa-431a-b8e7-bb8bae472a16 service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] No waiting events found dispatching network-vif-unplugged-de19b0bb-1a2b-4b91-a960-201573fd49dd {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:25:34.415353 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ebe6abc8-441d-46c1-8110-6a7e70b10377 req-d5de3ae6-0efa-431a-b8e7-bb8bae472a16 service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Received event network-vif-unplugged-de19b0bb-1a2b-4b91-a960-201573fd49dd for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:25:34.418403 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:34.519801 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 28db8142-2f27-4207-923f-f2f525867805] Instance destroyed successfully. Jan 26 19:25:34.520147 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'resources' on Instance uuid 28db8142-2f27-4207-923f-f2f525867805 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:25:35.024552 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:21:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='multiattach-server-1',id=103,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2DqNsC6gMM/rMUhFP33wutEbCJfSUZoLXi4knAQI7cL83VCjf4w8Ol5UVNVyCMMM4G5N6GoZa1daASRvj6YYLKi4Cz6e/HnHlp1PtG4CCeiOBWtfpou2xsaXI9ivoyQw==',key_name='tempest-keypair-1141931557',keypairs=,launch_index=0,launched_at=2026-01-27T00:21:20Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-60cd0d0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:21:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=28db8142-2f27-4207-923f-f2f525867805,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "address": "fa:16:3e:8b:61:75", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde19b0bb-1a", "ovs_interfaceid": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:25:35.025251 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "address": "fa:16:3e:8b:61:75", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde19b0bb-1a", "ovs_interfaceid": "de19b0bb-1a2b-4b91-a960-201573fd49dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:25:35.026327 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:61:75,bridge_name='br-int',has_traffic_filtering=True,id=de19b0bb-1a2b-4b91-a960-201573fd49dd,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde19b0bb-1a') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:25:35.026609 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:61:75,bridge_name='br-int',has_traffic_filtering=True,id=de19b0bb-1a2b-4b91-a960-201573fd49dd,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde19b0bb-1a') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:25:35.028678 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:35.029236 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde19b0bb-1a, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:25:35.030743 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:35.032937 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:25:35.033967 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:35.034402 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d7a46b4-0493-4d20-b25c-6d1914e24af1) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:25:35.035196 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:35.037920 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:25:35.042923 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:61:75,bridge_name='br-int',has_traffic_filtering=True,id=de19b0bb-1a2b-4b91-a960-201573fd49dd,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde19b0bb-1a') Jan 26 19:25:35.042923 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Deleting instance files /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805_del Jan 26 19:25:35.042923 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Deletion of /opt/stack/data/nova/instances/28db8142-2f27-4207-923f-f2f525867805_del complete Jan 26 19:25:35.553666 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:25:35.562314 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: 28db8142-2f27-4207-923f-f2f525867805] Took 1.29 seconds to destroy the instance on the hypervisor. Jan 26 19:25:35.562868 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:25:35.563177 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 28db8142-2f27-4207-923f-f2f525867805] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:25:35.563349 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 28db8142-2f27-4207-923f-f2f525867805] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:25:35.563962 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:25:35.609714 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:25:35.648175 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:25:35.648544 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:25:35.718466 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70/disk --force-share --output=json" returned: 0 in 0.069s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:25:35.720142 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Error from libvirt while getting description of instance-00000067: [Error Code 42] Domain not found: no domain with matching uuid '28db8142-2f27-4207-923f-f2f525867805' (instance-00000067): libvirt.libvirtError: Domain not found: no domain with matching uuid '28db8142-2f27-4207-923f-f2f525867805' (instance-00000067) Jan 26 19:25:35.723234 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] skipping disk /dev/sda (vda) as it is a volume {{(pid=189076) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12209}} Jan 26 19:25:35.832650 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:25:35.834212 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:25:35.855063 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.020s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:25:35.855540 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=7295MB free_disk=371.6615982055664GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:25:35.855754 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:35.856180 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:36.413384 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 28db8142-2f27-4207-923f-f2f525867805] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:25:36.479326 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ccdc2639-28f1-4d59-9d96-4963976d8aef req-2a7ed5e8-fc2a-4e62-b2df-01b33765905e service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Received event network-vif-unplugged-de19b0bb-1a2b-4b91-a960-201573fd49dd {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:25:36.479969 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ccdc2639-28f1-4d59-9d96-4963976d8aef req-2a7ed5e8-fc2a-4e62-b2df-01b33765905e service nova] Acquiring lock "28db8142-2f27-4207-923f-f2f525867805-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:36.480228 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ccdc2639-28f1-4d59-9d96-4963976d8aef req-2a7ed5e8-fc2a-4e62-b2df-01b33765905e service nova] Lock "28db8142-2f27-4207-923f-f2f525867805-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:36.480516 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ccdc2639-28f1-4d59-9d96-4963976d8aef req-2a7ed5e8-fc2a-4e62-b2df-01b33765905e service nova] Lock "28db8142-2f27-4207-923f-f2f525867805-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:36.483262 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ccdc2639-28f1-4d59-9d96-4963976d8aef req-2a7ed5e8-fc2a-4e62-b2df-01b33765905e service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] No waiting events found dispatching network-vif-unplugged-de19b0bb-1a2b-4b91-a960-201573fd49dd {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:25:36.483972 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ccdc2639-28f1-4d59-9d96-4963976d8aef req-2a7ed5e8-fc2a-4e62-b2df-01b33765905e service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Received event network-vif-unplugged-de19b0bb-1a2b-4b91-a960-201573fd49dd for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:25:36.484365 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ccdc2639-28f1-4d59-9d96-4963976d8aef req-2a7ed5e8-fc2a-4e62-b2df-01b33765905e service nova] [instance: 28db8142-2f27-4207-923f-f2f525867805] Received event network-vif-deleted-de19b0bb-1a2b-4b91-a960-201573fd49dd {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:25:36.904913 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance a7010931-641e-45d6-a8df-edd43c91ae9b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:25:36.905089 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance dbcbca53-6fab-4827-b3dc-a25e7eb6bb70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:25:36.905246 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 28db8142-2f27-4207-923f-f2f525867805 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:25:36.905574 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 3 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:25:36.905788 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=1088MB phys_disk=399GB used_disk=2GB total_vcpus=8 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:25:35 up 53 min, 13 users, load average: 1.56, 2.72, 3.58\n', 'num_instances': '3', 'num_vm_active': '3', 'num_task_None': '2', 'num_os_type_None': '3', 'num_proj_4a07dd99b19249acb501695a25608424': '3', 'io_workload': '0', 'num_task_deleting': '1'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:25:36.920067 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 28db8142-2f27-4207-923f-f2f525867805] Took 1.36 seconds to deallocate network for instance. Jan 26 19:25:37.040658 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:25:37.428864 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:37.545087 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:25:38.049812 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:25:38.050064 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.194s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:38.050493 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.622s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:38.177621 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:25:38.680701 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:25:39.050489 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:25:39.050744 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:25:39.050952 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:25:39.051142 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:25:39.185577 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.135s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:39.231574 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Deleted allocations for instance 28db8142-2f27-4207-923f-f2f525867805 Jan 26 19:25:40.080994 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:40.130212 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:25:40.130331 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] VM Stopped (Lifecycle Event) Jan 26 19:25:40.242893 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-dad09691-6029-4cc4-9009-7c8b9d974117 tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "28db8142-2f27-4207-923f-f2f525867805" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.484s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:40.633310 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-aba1c68a-aed8-4001-b2a9-b3a883756a64 None None] [instance: 7985cac9-68f6-40e7-bb90-7761b4220db7] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:25:40.895893 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:25:40.896207 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:25:40.967290 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:40.967635 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:40.968168 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:40.968507 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:40.968910 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:40.972017 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Terminating instance Jan 26 19:25:41.477924 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:25:41.504499 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:41.616314 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:41.622154 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:41.630893 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6e75f876-f7a9-496b-a085-5b93535d0380 req-79bc8a7f-6b66-4d82-8a55-6e51d6b500bd service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Received event network-vif-unplugged-3efc9a66-48a5-440c-b39f-8e74d8f7fc87 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:25:41.631095 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6e75f876-f7a9-496b-a085-5b93535d0380 req-79bc8a7f-6b66-4d82-8a55-6e51d6b500bd service nova] Acquiring lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:41.631328 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6e75f876-f7a9-496b-a085-5b93535d0380 req-79bc8a7f-6b66-4d82-8a55-6e51d6b500bd service nova] Lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:41.631481 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6e75f876-f7a9-496b-a085-5b93535d0380 req-79bc8a7f-6b66-4d82-8a55-6e51d6b500bd service nova] Lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:41.631658 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6e75f876-f7a9-496b-a085-5b93535d0380 req-79bc8a7f-6b66-4d82-8a55-6e51d6b500bd service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] No waiting events found dispatching network-vif-unplugged-3efc9a66-48a5-440c-b39f-8e74d8f7fc87 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:25:41.631882 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6e75f876-f7a9-496b-a085-5b93535d0380 req-79bc8a7f-6b66-4d82-8a55-6e51d6b500bd service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Received event network-vif-unplugged-3efc9a66-48a5-440c-b39f-8e74d8f7fc87 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:25:41.733504 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Instance destroyed successfully. Jan 26 19:25:41.733998 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'resources' on Instance uuid dbcbca53-6fab-4827-b3dc-a25e7eb6bb70 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:25:41.799205 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:41.892806 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:25:42.237944 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:20:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='multiattach-server-0',id=102,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2DqNsC6gMM/rMUhFP33wutEbCJfSUZoLXi4knAQI7cL83VCjf4w8Ol5UVNVyCMMM4G5N6GoZa1daASRvj6YYLKi4Cz6e/HnHlp1PtG4CCeiOBWtfpou2xsaXI9ivoyQw==',key_name='tempest-keypair-1141931557',keypairs=,launch_index=0,launched_at=2026-01-27T00:21:06Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-tbx0ak00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:21:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=dbcbca53-6fab-4827-b3dc-a25e7eb6bb70,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "address": "fa:16:3e:6b:25:33", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efc9a66-48", "ovs_interfaceid": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:25:42.238346 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "address": "fa:16:3e:6b:25:33", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efc9a66-48", "ovs_interfaceid": "3efc9a66-48a5-440c-b39f-8e74d8f7fc87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:25:42.238646 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:25:33,bridge_name='br-int',has_traffic_filtering=True,id=3efc9a66-48a5-440c-b39f-8e74d8f7fc87,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efc9a66-48') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:25:42.238892 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:25:33,bridge_name='br-int',has_traffic_filtering=True,id=3efc9a66-48a5-440c-b39f-8e74d8f7fc87,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efc9a66-48') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:25:42.240249 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:42.240521 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3efc9a66-48, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:25:42.285554 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:42.287830 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:25:42.288737 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:42.289432 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:42.289614 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66c9462d-80c2-488f-b16e-bbf6b99baae8) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:25:42.290145 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:42.291723 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:25:42.292610 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:42.294444 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:25:33,bridge_name='br-int',has_traffic_filtering=True,id=3efc9a66-48a5-440c-b39f-8e74d8f7fc87,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efc9a66-48') Jan 26 19:25:42.294706 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Deleting instance files /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70_del Jan 26 19:25:42.295175 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Deletion of /opt/stack/data/nova/instances/dbcbca53-6fab-4827-b3dc-a25e7eb6bb70_del complete Jan 26 19:25:42.803885 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Took 1.33 seconds to destroy the instance on the hypervisor. Jan 26 19:25:42.804666 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:25:42.805185 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:25:42.805505 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:25:42.806081 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:25:42.871468 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:25:43.587437 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:25:43.680915 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3d5c9734-facf-4dd9-994c-e5ad348025c7 req-bb832965-3900-4a3a-9a49-1aaf2e2a7f92 service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Received event network-vif-unplugged-3efc9a66-48a5-440c-b39f-8e74d8f7fc87 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:25:43.681205 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3d5c9734-facf-4dd9-994c-e5ad348025c7 req-bb832965-3900-4a3a-9a49-1aaf2e2a7f92 service nova] Acquiring lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:43.681426 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3d5c9734-facf-4dd9-994c-e5ad348025c7 req-bb832965-3900-4a3a-9a49-1aaf2e2a7f92 service nova] Lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:43.681636 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3d5c9734-facf-4dd9-994c-e5ad348025c7 req-bb832965-3900-4a3a-9a49-1aaf2e2a7f92 service nova] Lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:43.681808 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3d5c9734-facf-4dd9-994c-e5ad348025c7 req-bb832965-3900-4a3a-9a49-1aaf2e2a7f92 service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] No waiting events found dispatching network-vif-unplugged-3efc9a66-48a5-440c-b39f-8e74d8f7fc87 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:25:43.681992 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3d5c9734-facf-4dd9-994c-e5ad348025c7 req-bb832965-3900-4a3a-9a49-1aaf2e2a7f92 service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Received event network-vif-unplugged-3efc9a66-48a5-440c-b39f-8e74d8f7fc87 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:25:43.682121 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3d5c9734-facf-4dd9-994c-e5ad348025c7 req-bb832965-3900-4a3a-9a49-1aaf2e2a7f92 service nova] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Received event network-vif-deleted-3efc9a66-48a5-440c-b39f-8e74d8f7fc87 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:25:44.091321 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Took 1.29 seconds to deallocate network for instance. Jan 26 19:25:44.604191 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:44.604499 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:44.745888 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:25:45.250168 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:25:45.759900 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.155s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:45.984818 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Deleted allocations for instance dbcbca53-6fab-4827-b3dc-a25e7eb6bb70 Jan 26 19:25:46.998919 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-0f6e149e-c104-419c-a8b1-ea936cfaa25a tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "dbcbca53-6fab-4827-b3dc-a25e7eb6bb70" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.031s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:47.294576 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:25:47.296331 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:25:47.296677 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:25:47.297026 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:25:47.344488 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:47.344941 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:25:47.892542 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:25:48.692956 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "a7010931-641e-45d6-a8df-edd43c91ae9b" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:48.692956 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "a7010931-641e-45d6-a8df-edd43c91ae9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:48.692956 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "a7010931-641e-45d6-a8df-edd43c91ae9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:48.693822 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "a7010931-641e-45d6-a8df-edd43c91ae9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:48.693822 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "a7010931-641e-45d6-a8df-edd43c91ae9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:48.697668 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Terminating instance Jan 26 19:25:49.203526 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:25:49.230880 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:49.240101 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:49.256998 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:49.268369 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:49.387928 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f9283854-e366-4530-a48f-06d060d2ef13 req-64d1c5ce-37c9-4f51-80af-4839fbaea327 service nova] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Received event network-vif-unplugged-5fdbea35-aadf-4a3d-8726-9c25e56a741d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:25:49.388227 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f9283854-e366-4530-a48f-06d060d2ef13 req-64d1c5ce-37c9-4f51-80af-4839fbaea327 service nova] Acquiring lock "a7010931-641e-45d6-a8df-edd43c91ae9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:49.388431 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f9283854-e366-4530-a48f-06d060d2ef13 req-64d1c5ce-37c9-4f51-80af-4839fbaea327 service nova] Lock "a7010931-641e-45d6-a8df-edd43c91ae9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:49.388588 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-f9283854-e366-4530-a48f-06d060d2ef13 req-64d1c5ce-37c9-4f51-80af-4839fbaea327 service nova] Lock "a7010931-641e-45d6-a8df-edd43c91ae9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:49.388744 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f9283854-e366-4530-a48f-06d060d2ef13 req-64d1c5ce-37c9-4f51-80af-4839fbaea327 service nova] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] No waiting events found dispatching network-vif-unplugged-5fdbea35-aadf-4a3d-8726-9c25e56a741d {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:25:49.388913 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-f9283854-e366-4530-a48f-06d060d2ef13 req-64d1c5ce-37c9-4f51-80af-4839fbaea327 service nova] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Received event network-vif-unplugged-5fdbea35-aadf-4a3d-8726-9c25e56a741d for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:25:49.492179 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Instance destroyed successfully. Jan 26 19:25:49.492705 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lazy-loading 'resources' on Instance uuid a7010931-641e-45d6-a8df-edd43c91ae9b {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:25:49.520350 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:25:49.520476 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 28db8142-2f27-4207-923f-f2f525867805] VM Stopped (Lifecycle Event) Jan 26 19:25:49.997501 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:20:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1766441062',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-attachvolumemultiattachtest-server-1766441062',id=101,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-01-27T00:20:50Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='4a07dd99b19249acb501695a25608424',ramdisk_id='',reservation_id='r-ohq0mg9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1495503700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1495503700-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:20:50Z,user_data=None,user_id='d2494a2c41134b13a25b86d1bdfdd65f',uuid=a7010931-641e-45d6-a8df-edd43c91ae9b,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fdbea35-aadf-4a3d-8726-9c25e56a741d", "address": "fa:16:3e:c2:72:0d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdbea35-aa", "ovs_interfaceid": "5fdbea35-aadf-4a3d-8726-9c25e56a741d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:25:49.998464 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converting VIF {"id": "5fdbea35-aadf-4a3d-8726-9c25e56a741d", "address": "fa:16:3e:c2:72:0d", "network": {"id": "5c309465-8af3-4bd5-894e-e26bf04fe05a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-118289847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a07dd99b19249acb501695a25608424", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdbea35-aa", "ovs_interfaceid": "5fdbea35-aadf-4a3d-8726-9c25e56a741d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:25:49.998903 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:72:0d,bridge_name='br-int',has_traffic_filtering=True,id=5fdbea35-aadf-4a3d-8726-9c25e56a741d,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdbea35-aa') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:25:49.999375 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:72:0d,bridge_name='br-int',has_traffic_filtering=True,id=5fdbea35-aadf-4a3d-8726-9c25e56a741d,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdbea35-aa') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:25:50.001742 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:50.002248 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fdbea35-aa, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:25:50.024567 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-45a9dc5b-6f7e-4757-b541-dcf535b270f2 None None] [instance: 28db8142-2f27-4207-923f-f2f525867805] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:25:50.034651 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:50.036868 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:25:50.037931 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:50.038824 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:50.039100 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89b26d62-e9c1-4061-a2b0-b152450b998f) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:25:50.040034 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:50.042187 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:25:50.043165 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:50.045981 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:72:0d,bridge_name='br-int',has_traffic_filtering=True,id=5fdbea35-aadf-4a3d-8726-9c25e56a741d,network=Network(5c309465-8af3-4bd5-894e-e26bf04fe05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdbea35-aa') Jan 26 19:25:50.105755 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] calling os-brick to detach iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jan 26 19:25:50.107407 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2', 'target_lun': 0, 'volume_id': 'ca64cda4-10f8-4f8f-b040-884ced50b4d2', 'auth_method': 'CHAP', 'auth_username': '7S6USSANTqt6CsGomydX', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sda'}, None), 'kwargs': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:25:50.107848 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:25:50.108451 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:25:50.110813 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:25:50.122375 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:25:50.122568 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e62126-d487-4e0b-a294-6b781548629a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:25:50.122921 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:25:50.122921 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:25:50.122921 np0005596550.novalocal nova-compute[189076]: iSNS: Jan 26 19:25:50.122921 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:25:50.122921 np0005596550.novalocal nova-compute[189076]: STATIC: Jan 26 19:25:50.122921 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 Jan 26 19:25:50.122921 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:25:50.122921 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:25:50.122921 np0005596550.novalocal nova-compute[189076]: FIRMWARE: Jan 26 19:25:50.122921 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:25:50.122921 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:25:50.123307 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:25:50.123307 np0005596550.novalocal nova-compute[189076]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:25:50.123307 np0005596550.novalocal nova-compute[189076]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=189076) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:25:50.123395 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2', 0)] {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:25:50.124812 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:25:50.139535 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.014s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:25:50.140003 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd6a170-dac4-46b5-95a5-952ac1b6b5c3]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:25:50.141927 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:25:50.155819 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.014s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:25:50.155966 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[231d87e6-19d1-4271-9244-af6d4653b177]: (4, ('tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:25:50.156457 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:25:50.156457 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:25:50.156726 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsi session list stdout=tcp: [28] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 (non-flash) Jan 26 19:25:50.156726 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:25:50.157485 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Resulting device map defaultdict(. at 0x7fd768171620>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2'): ({'sda'}, set())}) {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:25:50.157823 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Removing single pathed devices sda {{(pid=189076) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:25:50.160796 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:25:50.166929 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:25:50.168985 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[8186461e-4ab6-49fd-9efc-9d41b5cb09cd]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:25:50.168985 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:25:50.168985 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:25:50.168985 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:25:50.168985 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:25:50.168985 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:25:50.168985 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:25:50.168985 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:25:50.168985 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:25:50.168985 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:25:50.168985 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:25:50.168985 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:25:50.168985 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:25:50.168985 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:25:50.168985 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:25:50.168985 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:25:50.168985 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:25:50.168985 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:25:50.168985 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:25:50.168985 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:25:50.168985 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:25:50.168985 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:25:50.170859 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[8186461e-4ab6-49fd-9efc-9d41b5cb09cd]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:25:50.171722 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Flushing IO for device /dev/sda {{(pid=189076) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:25:50.173044 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sda {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:25:50.183026 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sda" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:25:50.183276 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fe5811-1475-4fb9-accd-8a7f6e4b9b01]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:25:50.183924 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Remove SCSI device /dev/sda with /sys/block/sda/device/delete {{(pid=189076) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:25:50.185284 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sda/device/delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:25:50.235273 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sda/device/delete" returned: 0 in 0.050s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:25:50.235447 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[34aa3d1d-748b-439f-a61e-6e6eab935c64]: (4, ('1', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:25:50.235928 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Checking to see if SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:25:50.236113 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:25:50.236434 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2')] {{(pid=189076) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:25:50.237848 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:25:50.253310 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.014s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:25:50.253571 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02e6144-8797-42c7-b0b6-8a2afaa0b63f]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:25:50.254202 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:25:50.257755 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260 --logout {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:25:50.289140 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260 --logout" returned: 0 in 0.034s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:25:50.289424 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da34715-25e7-40d8-b4a0-2b008a1bc93b]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2, portal: 38.102.83.18,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:25:50.290014 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2, portal: 38.102.83.18,3260] Jan 26 19:25:50.290014 np0005596550.novalocal nova-compute[189076]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2, portal: 38.102.83.18,3260] successful. Jan 26 19:25:50.290014 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:25:50.290913 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260 --op delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:25:50.300542 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ca64cda4-10f8-4f8f-b040-884ced50b4d2 -p 38.102.83.18:3260 --op delete" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:25:50.300821 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[59857cee-b422-4bc6-b575-0611dc53b591]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:25:50.301162 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:25:50.301472 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.193s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:25:50.301699 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] <== disconnect_volume: return (193ms) None {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:25:50.301916 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Disconnected iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jan 26 19:25:50.302345 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Deleting instance files /opt/stack/data/nova/instances/a7010931-641e-45d6-a8df-edd43c91ae9b_del Jan 26 19:25:50.303047 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Deletion of /opt/stack/data/nova/instances/a7010931-641e-45d6-a8df-edd43c91ae9b_del complete Jan 26 19:25:50.813462 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Took 1.61 seconds to destroy the instance on the hypervisor. Jan 26 19:25:50.813889 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:25:50.814216 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:25:50.814392 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:25:50.814730 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:25:50.890057 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:25:51.232076 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e19adc6e-5c07-4182-9f71-242511f574b3 req-a39121a0-6707-4a9a-b1cd-520498dcdd0e service nova] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Received event network-vif-deleted-5fdbea35-aadf-4a3d-8726-9c25e56a741d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:25:51.232076 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-e19adc6e-5c07-4182-9f71-242511f574b3 req-a39121a0-6707-4a9a-b1cd-520498dcdd0e service nova] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Neutron deleted interface 5fdbea35-aadf-4a3d-8726-9c25e56a741d; detaching it from the instance and deleting it from the info cache Jan 26 19:25:51.232076 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-e19adc6e-5c07-4182-9f71-242511f574b3 req-a39121a0-6707-4a9a-b1cd-520498dcdd0e service nova] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:25:51.432073 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3936c36e-d5fa-41c5-a3c8-a6b7fbe964d5 req-34ce4fbb-882a-4a97-ae61-4324dd0d1da2 service nova] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Received event network-vif-unplugged-5fdbea35-aadf-4a3d-8726-9c25e56a741d {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:25:51.432622 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3936c36e-d5fa-41c5-a3c8-a6b7fbe964d5 req-34ce4fbb-882a-4a97-ae61-4324dd0d1da2 service nova] Acquiring lock "a7010931-641e-45d6-a8df-edd43c91ae9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:51.434279 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3936c36e-d5fa-41c5-a3c8-a6b7fbe964d5 req-34ce4fbb-882a-4a97-ae61-4324dd0d1da2 service nova] Lock "a7010931-641e-45d6-a8df-edd43c91ae9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:51.434581 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-3936c36e-d5fa-41c5-a3c8-a6b7fbe964d5 req-34ce4fbb-882a-4a97-ae61-4324dd0d1da2 service nova] Lock "a7010931-641e-45d6-a8df-edd43c91ae9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:51.434905 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3936c36e-d5fa-41c5-a3c8-a6b7fbe964d5 req-34ce4fbb-882a-4a97-ae61-4324dd0d1da2 service nova] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] No waiting events found dispatching network-vif-unplugged-5fdbea35-aadf-4a3d-8726-9c25e56a741d {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:25:51.435216 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-3936c36e-d5fa-41c5-a3c8-a6b7fbe964d5 req-34ce4fbb-882a-4a97-ae61-4324dd0d1da2 service nova] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Received event network-vif-unplugged-5fdbea35-aadf-4a3d-8726-9c25e56a741d for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:25:51.701868 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:25:51.735446 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e19adc6e-5c07-4182-9f71-242511f574b3 req-a39121a0-6707-4a9a-b1cd-520498dcdd0e service nova] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Detach interface failed, port_id=5fdbea35-aadf-4a3d-8726-9c25e56a741d, reason: Instance a7010931-641e-45d6-a8df-edd43c91ae9b could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:25:52.205880 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Took 1.39 seconds to deallocate network for instance. Jan 26 19:25:55.087424 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:25:55.087424 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:25:55.087424 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:25:55.087424 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:25:55.088661 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:25:55.088661 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:25:55.264260 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Took 3.06 seconds to detach 1 volumes for instance. Jan 26 19:25:55.770174 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:25:55.770414 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:25:55.890563 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:25:56.395069 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:25:56.733533 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:25:56.733687 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] VM Stopped (Lifecycle Event) Jan 26 19:25:56.901444 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.131s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:25:56.961212 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Deleted allocations for instance a7010931-641e-45d6-a8df-edd43c91ae9b Jan 26 19:25:57.238034 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ef8c7e7e-e045-4517-9410-0c37ae5efc83 None None] [instance: dbcbca53-6fab-4827-b3dc-a25e7eb6bb70] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:25:57.971941 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-757919ef-1feb-48f8-aed3-8343a71ace6c tempest-AttachVolumeMultiAttachTest-1495503700 tempest-AttachVolumeMultiAttachTest-1495503700-project-member] Lock "a7010931-641e-45d6-a8df-edd43c91ae9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 9.280s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:26:00.088794 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:26:02.613380 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:26:04.490907 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:26:04.491335 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] VM Stopped (Lifecycle Event) Jan 26 19:26:04.994903 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a5f5104f-0ac2-4d8d-ac67-a5be50311d03 None None] [instance: a7010931-641e-45d6-a8df-edd43c91ae9b] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:26:05.090901 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:26:10.092835 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:26:10.094469 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:26:10.094680 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:26:10.094929 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:26:10.123856 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:26:10.124139 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:26:15.124979 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:26:20.126597 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:26:25.127374 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:26:26.896872 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:26:30.129366 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:26:33.896677 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:26:34.404900 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:26:34.404900 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:26:34.405196 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:26:34.405309 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:26:34.526609 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:26:34.527743 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:26:34.551413 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.023s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:26:34.551959 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=8114MB free_disk=371.7193031311035GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:26:34.552230 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:26:34.552453 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:26:35.130682 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:26:35.629443 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 0 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:26:35.629443 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=512MB phys_disk=399GB used_disk=0GB total_vcpus=8 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:26:34 up 54 min, 13 users, load average: 1.22, 2.42, 3.42\n'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:26:35.684931 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:26:36.191782 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:26:36.700562 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:26:36.700958 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.148s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:26:38.700577 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:26:38.701070 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:26:38.896072 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:26:38.896290 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:26:40.133441 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:26:40.896081 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:26:40.896265 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:26:41.892732 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:26:45.135559 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:26:45.136704 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:26:45.137038 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:26:45.137284 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:26:45.137971 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:26:45.138578 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:26:50.139035 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:26:55.141017 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:26:55.331056 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:27:00.144662 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:27:05.146687 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:27:10.149136 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:27:10.150515 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:27:10.150625 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:27:10.150680 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:27:10.183128 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:27:10.183323 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:27:15.184622 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:27:15.185997 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:27:15.186127 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:27:15.186127 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:27:15.194446 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:27:15.194721 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:27:20.195223 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:27:20.196809 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:27:20.196809 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:27:20.196809 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:27:20.196809 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:27:20.196809 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:27:25.198278 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:27:26.896660 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:27:30.200369 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:27:33.896009 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:27:34.402112 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:27:34.402489 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:27:34.402798 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:27:34.403085 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:27:34.528755 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:27:34.530170 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:27:34.548672 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.018s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:27:34.549276 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=8051MB free_disk=371.7173309326172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:27:34.549548 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:27:34.550017 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:27:35.202364 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:27:35.586530 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 0 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:27:35.586736 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=512MB phys_disk=399GB used_disk=0GB total_vcpus=8 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:27:34 up 55 min, 13 users, load average: 1.08, 2.14, 3.26\n'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:27:35.620920 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:27:36.124925 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:27:36.630490 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:27:36.631076 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.081s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:27:38.630591 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:27:38.630943 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:27:39.896409 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:27:39.896884 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:27:40.203868 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:27:40.204879 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:27:40.205150 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:27:40.205284 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:27:40.205678 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:27:40.206071 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:27:41.895065 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:27:41.895510 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:27:42.892369 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:27:45.253045 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:27:50.254285 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:27:51.891926 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:27:55.255159 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:27:55.591080 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:28:00.292954 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:28:05.293907 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:28:05.295020 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:28:05.295233 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:28:05.295395 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:28:05.295921 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:28:05.296352 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:28:10.297484 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:28:15.299166 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:28:20.301238 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:28:20.302907 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:28:20.303111 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:28:20.303323 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:28:20.348619 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:28:20.349214 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:28:25.350177 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:28:27.895677 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:28:30.351625 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:28:35.353655 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:28:35.895849 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:28:36.405503 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:28:36.406005 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:28:36.406005 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:28:36.406005 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:28:36.491924 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:28:36.492919 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:28:36.509607 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.016s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:28:36.509881 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=8140MB free_disk=371.7173309326172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:28:36.510061 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:28:36.510367 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:28:37.571232 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 0 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:28:37.571685 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=512MB phys_disk=399GB used_disk=0GB total_vcpus=8 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:28:36 up 56 min, 13 users, load average: 1.32, 2.02, 3.14\n'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:28:37.615196 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:28:38.120277 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:28:38.627634 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:28:38.628109 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.117s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:28:40.355281 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:28:40.628396 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:28:40.628586 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:28:40.895602 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:28:40.896083 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:28:42.895849 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:28:42.896379 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:28:44.893699 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:28:45.357243 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:28:50.358861 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:28:55.361108 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:28:55.928935 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:29:00.362939 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:29:00.895543 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:29:00.895748 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use..do_register_storage_use" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:29:00.896245 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use..do_register_storage_use" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:29:00.896572 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use..do_register_storage_use" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:29:00.896730 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users..do_get_storage_users" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:29:00.896988 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users..do_get_storage_users" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:29:00.897244 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users..do_get_storage_users" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:29:01.904851 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Verify base images {{(pid=189076) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}} Jan 26 19:29:01.904851 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa Jan 26 19:29:01.904851 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Unknown base file: /opt/stack/data/nova/instances/_base/dfcdf05e47fabace3ed376df7153f10545467524 Jan 26 19:29:01.904851 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Unknown base file: /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f Jan 26 19:29:01.904851 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bf7c883a9f04d8cb917d1e37e18eb451793008c2 Jan 26 19:29:01.904851 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d3875cd64de109b6d5b2f4d15593242e2a6824fa Jan 26 19:29:01.904851 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Unknown base file: /opt/stack/data/nova/instances/_base/fc9721f2078a4f7db01243ee62ffcdee01e56a7c Jan 26 19:29:01.904851 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Unknown base file: /opt/stack/data/nova/instances/_base/64ab13af28d3a39f287192e8c7bacc98b16fccd8 Jan 26 19:29:01.905537 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c08e5e0fcf554a6a5f615e809b1ec1707094aed5 Jan 26 19:29:01.905537 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5359100dcec0f3930af3752a640f2217ee2a6cef Jan 26 19:29:01.905537 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Unknown base file: /opt/stack/data/nova/instances/_base/21f203906098c75c1e3e244c2d345064ce29e81d Jan 26 19:29:01.905537 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Removable base files: /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa /opt/stack/data/nova/instances/_base/dfcdf05e47fabace3ed376df7153f10545467524 /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f /opt/stack/data/nova/instances/_base/bf7c883a9f04d8cb917d1e37e18eb451793008c2 /opt/stack/data/nova/instances/_base/d3875cd64de109b6d5b2f4d15593242e2a6824fa /opt/stack/data/nova/instances/_base/fc9721f2078a4f7db01243ee62ffcdee01e56a7c /opt/stack/data/nova/instances/_base/64ab13af28d3a39f287192e8c7bacc98b16fccd8 /opt/stack/data/nova/instances/_base/c08e5e0fcf554a6a5f615e809b1ec1707094aed5 /opt/stack/data/nova/instances/_base/5359100dcec0f3930af3752a640f2217ee2a6cef /opt/stack/data/nova/instances/_base/21f203906098c75c1e3e244c2d345064ce29e81d Jan 26 19:29:01.905660 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa Jan 26 19:29:01.905807 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dfcdf05e47fabace3ed376df7153f10545467524 Jan 26 19:29:01.905912 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/791283f4306f6266c365d052f132d740f0c9b85f Jan 26 19:29:01.906049 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bf7c883a9f04d8cb917d1e37e18eb451793008c2 Jan 26 19:29:01.906172 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d3875cd64de109b6d5b2f4d15593242e2a6824fa Jan 26 19:29:01.906295 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fc9721f2078a4f7db01243ee62ffcdee01e56a7c Jan 26 19:29:01.906414 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/64ab13af28d3a39f287192e8c7bacc98b16fccd8 Jan 26 19:29:01.906527 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c08e5e0fcf554a6a5f615e809b1ec1707094aed5 Jan 26 19:29:01.906645 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5359100dcec0f3930af3752a640f2217ee2a6cef Jan 26 19:29:01.906763 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/21f203906098c75c1e3e244c2d345064ce29e81d Jan 26 19:29:01.906884 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Verification complete {{(pid=189076) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}} Jan 26 19:29:01.906981 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Verify swap images {{(pid=189076) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}} Jan 26 19:29:01.907090 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.imagecache [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Verify ephemeral images {{(pid=189076) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}} Jan 26 19:29:05.364563 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:29:10.366750 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:29:10.369408 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:29:10.369408 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:29:10.369408 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:29:10.369408 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:29:10.369408 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:29:15.370131 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:29:15.410949 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:29:15.412043 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5042 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:29:15.412152 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:29:15.412567 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:29:15.412951 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:29:20.413532 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:29:25.415429 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:29:26.897870 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:29:29.402421 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:29:30.417567 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:29:35.418556 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:29:35.896074 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:29:36.403178 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:29:36.403178 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:29:36.403178 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:29:36.403178 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:29:36.490380 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:29:36.491143 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:29:36.506450 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.015s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:29:36.506848 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=7828MB free_disk=371.71693420410156GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:29:36.507053 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:29:36.507343 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:29:37.690279 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 0 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:29:37.690612 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=512MB phys_disk=399GB used_disk=0GB total_vcpus=8 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:29:36 up 57 min, 14 users, load average: 1.64, 1.97, 3.05\n'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:29:37.717273 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Refreshing inventories for resource provider f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}} Jan 26 19:29:37.742975 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Updating ProviderTree inventory for provider f627156c-932e-4a32-97b3-315a994a2ac9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}} Jan 26 19:29:37.743114 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Updating inventory in ProviderTree for provider f627156c-932e-4a32-97b3-315a994a2ac9 with inventory: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jan 26 19:29:37.764228 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Refreshing aggregate associations for resource provider f627156c-932e-4a32-97b3-315a994a2ac9, aggregates: None {{(pid=189076) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}} Jan 26 19:29:37.812465 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Refreshing trait associations for resource provider f627156c-932e-4a32-97b3-315a994a2ac9, traits: COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_ADDRESS_SPACE_EMULATED,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOUND_MODEL_SB16,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_IGB,HW_ARCH_X86_64,COMPUTE_ARCH_X86_64,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_SECURITY_STATELESS_FIRMWARE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOUND_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOUND_MODEL_AC97,COMPUTE_SOUND_MODEL_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ADDRESS_SPACE_PASSTHROUGH {{(pid=189076) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}} Jan 26 19:29:37.846563 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:29:38.350909 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:29:38.860414 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:29:38.861053 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.353s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:29:38.861484 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:29:38.862027 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Cleaning up deleted instances {{(pid=189076) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11960}} Jan 26 19:29:39.366888 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] There are 0 instances to clean {{(pid=189076) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11969}} Jan 26 19:29:40.420842 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:29:41.367650 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:29:41.367989 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:29:41.368291 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:29:42.895575 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:29:43.895326 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:29:43.895472 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:29:45.422484 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:29:46.892364 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:29:50.423405 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:29:53.918741 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._sync_power_states {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:29:55.398079 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:29:55.424348 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:29:58.568010 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:00.426718 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:05.428065 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:08.896861 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:30:08.896861 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Cleaning up deleted instances with incomplete migration {{(pid=189076) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11998}} Jan 26 19:30:10.430080 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:15.431626 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:30:20.432494 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:25.434624 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:30:30.437367 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:31.401172 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:30:33.587482 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:35.439591 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:35.763380 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:36.896374 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:30:37.402041 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:30:37.402235 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:30:37.402374 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:30:37.402532 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:30:37.511589 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:30:37.512654 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:37.529573 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.017s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:37.529964 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=7645MB free_disk=371.84106063842773GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:30:37.530161 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:30:37.530464 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:30:38.572721 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:38.583308 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 0 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:30:38.583631 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=512MB phys_disk=399GB used_disk=0GB total_vcpus=8 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:30:37 up 58 min, 13 users, load average: 1.41, 1.84, 2.94\n'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:30:38.631136 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:30:39.136530 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:30:39.648158 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:30:39.648566 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.118s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:30:40.021307 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:40.440994 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:41.649289 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:30:41.649798 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:30:41.650188 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:30:42.100648 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:43.575613 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:43.896574 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:30:43.896574 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:30:44.896459 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:30:45.442406 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:46.656260 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Acquiring lock "4b6317aa-80aa-4472-a224-12c1e111fd29" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:30:46.656540 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "4b6317aa-80aa-4472-a224-12c1e111fd29" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:30:47.159543 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:30:47.733524 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:30:47.733524 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:30:47.740954 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:30:47.740954 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Claim successful on node np0005596550.novalocal Jan 26 19:30:48.577930 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:48.844028 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:30:48.891956 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:30:49.348117 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:30:49.853853 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.121s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:30:49.854477 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:30:50.378879 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:30:50.378879 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:30:50.378879 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:30:50.378879 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:30:50.445080 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:50.504165 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4107107928ee48a0a131a29a2bc03bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510ca3caf6744020a287b409fd087b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:30:50.865008 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:30:51.031028 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Successfully created port: 411fbe6e-4a07-4237-8ab5-32bd2faada30 {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:30:51.370331 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:30:51.512639 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Successfully updated port: 411fbe6e-4a07-4237-8ab5-32bd2faada30 {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:30:51.596797 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a15b58af-5c9d-4a77-bd96-c3d59c217304 req-04057a58-08f1-403c-a83d-760d103e03bf service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Received event network-changed-411fbe6e-4a07-4237-8ab5-32bd2faada30 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:30:51.598810 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-a15b58af-5c9d-4a77-bd96-c3d59c217304 req-04057a58-08f1-403c-a83d-760d103e03bf service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Refreshing instance network info cache due to event network-changed-411fbe6e-4a07-4237-8ab5-32bd2faada30. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:30:51.598810 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a15b58af-5c9d-4a77-bd96-c3d59c217304 req-04057a58-08f1-403c-a83d-760d103e03bf service nova] Acquiring lock "refresh_cache-4b6317aa-80aa-4472-a224-12c1e111fd29" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:30:51.598810 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a15b58af-5c9d-4a77-bd96-c3d59c217304 req-04057a58-08f1-403c-a83d-760d103e03bf service nova] Acquired lock "refresh_cache-4b6317aa-80aa-4472-a224-12c1e111fd29" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:30:51.598810 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-a15b58af-5c9d-4a77-bd96-c3d59c217304 req-04057a58-08f1-403c-a83d-760d103e03bf service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Refreshing network info cache for port 411fbe6e-4a07-4237-8ab5-32bd2faada30 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:30:52.017876 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Acquiring lock "refresh_cache-4b6317aa-80aa-4472-a224-12c1e111fd29" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:30:52.101916 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-a15b58af-5c9d-4a77-bd96-c3d59c217304 req-04057a58-08f1-403c-a83d-760d103e03bf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:30:52.181488 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-a15b58af-5c9d-4a77-bd96-c3d59c217304 req-04057a58-08f1-403c-a83d-760d103e03bf service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:30:52.318074 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-a15b58af-5c9d-4a77-bd96-c3d59c217304 req-04057a58-08f1-403c-a83d-760d103e03bf service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:30:52.383792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:30:52.384575 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:30:52.384836 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Creating image(s) Jan 26 19:30:52.385277 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b6317aa-80aa-4472-a224-12c1e111fd29/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:30:52.385447 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "/opt/stack/data/nova/instances/4b6317aa-80aa-4472-a224-12c1e111fd29/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:30:52.386024 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "/opt/stack/data/nova/instances/4b6317aa-80aa-4472-a224-12c1e111fd29/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:30:52.386534 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:30:52.389230 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:30:52.390358 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:52.457652 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.067s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:52.458073 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:30:52.458512 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:30:52.458861 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:30:52.461652 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:30:52.461965 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:52.557105 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.094s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:52.557667 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/4b6317aa-80aa-4472-a224-12c1e111fd29/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:52.593527 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/4b6317aa-80aa-4472-a224-12c1e111fd29/disk 1073741824" returned: 0 in 0.035s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:52.594096 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.135s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:30:52.594578 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:52.658944 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.064s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:52.659398 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b6317aa-80aa-4472-a224-12c1e111fd29/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:30:52.659707 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b6317aa-80aa-4472-a224-12c1e111fd29/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:52.754833 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b6317aa-80aa-4472-a224-12c1e111fd29/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:52.755262 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Cannot resize image /opt/stack/data/nova/instances/4b6317aa-80aa-4472-a224-12c1e111fd29/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:30:52.755662 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:30:52.755919 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Ensure instance console log exists: /opt/stack/data/nova/instances/4b6317aa-80aa-4472-a224-12c1e111fd29/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:30:52.756289 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:30:52.756615 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:30:52.756935 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:30:52.821556 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-a15b58af-5c9d-4a77-bd96-c3d59c217304 req-04057a58-08f1-403c-a83d-760d103e03bf service nova] Releasing lock "refresh_cache-4b6317aa-80aa-4472-a224-12c1e111fd29" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:30:52.822471 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Acquired lock "refresh_cache-4b6317aa-80aa-4472-a224-12c1e111fd29" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:30:52.822966 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:30:53.372190 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:30:53.490430 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:30:53.580556 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:53.657448 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Updating instance_info_cache with network_info: [{"id": "411fbe6e-4a07-4237-8ab5-32bd2faada30", "address": "fa:16:3e:97:39:15", "network": {"id": "6380647b-f467-4892-a9d3-27c99e541f05", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1742156155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "510ca3caf6744020a287b409fd087b27", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap411fbe6e-4a", "ovs_interfaceid": "411fbe6e-4a07-4237-8ab5-32bd2faada30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:30:54.162231 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Releasing lock "refresh_cache-4b6317aa-80aa-4472-a224-12c1e111fd29" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:30:54.162839 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Instance network_info: |[{"id": "411fbe6e-4a07-4237-8ab5-32bd2faada30", "address": "fa:16:3e:97:39:15", "network": {"id": "6380647b-f467-4892-a9d3-27c99e541f05", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1742156155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "510ca3caf6744020a287b409fd087b27", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap411fbe6e-4a", "ovs_interfaceid": "411fbe6e-4a07-4237-8ab5-32bd2faada30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:30:54.166677 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Start _get_guest_xml network_info=[{"id": "411fbe6e-4a07-4237-8ab5-32bd2faada30", "address": "fa:16:3e:97:39:15", "network": {"id": "6380647b-f467-4892-a9d3-27c99e541f05", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1742156155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "510ca3caf6744020a287b409fd087b27", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap411fbe6e-4a", "ovs_interfaceid": "411fbe6e-4a07-4237-8ab5-32bd2faada30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:30:54.172324 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:30:54.174327 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-VolumesExtendAttachedTest-instance-1336989183', uuid='4b6317aa-80aa-4472-a224-12c1e111fd29'), owner=OwnerMeta(userid='4107107928ee48a0a131a29a2bc03bda', username='tempest-VolumesExtendAttachedTest-486327567-project-member', projectid='510ca3caf6744020a287b409fd087b27', projectname='tempest-VolumesExtendAttachedTest-486327567'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "411fbe6e-4a07-4237-8ab5-32bd2faada30", "address": "fa:16:3e:97:39:15", "network": {"id": "6380647b-f467-4892-a9d3-27c99e541f05", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1742156155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "510ca3caf6744020a287b409fd087b27", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap411fbe6e-4a", "ovs_interfaceid": "411fbe6e-4a07-4237-8ab5-32bd2faada30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769473854.1736715) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:30:54.176481 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:30:54.177125 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:30:54.178987 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:30:54.179580 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:30:54.181256 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:30:54.182007 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:30:54.182404 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:30:54.182683 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:30:54.183048 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:30:54.183315 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:30:54.183604 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:30:54.184033 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:30:54.184382 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:30:54.184695 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:30:54.185021 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:30:54.185423 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:30:54.190828 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:30:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1336989183',display_name='tempest-VolumesExtendAttachedTest-instance-1336989183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-volumesextendattachedtest-instance-1336989183',id=107,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxr0MYFPDiXXMq0IRKiJUx/l5ykTCKCGTax4kV+H9r21+zoktAmCqcTLEYHT9bzLdOMhYOPUkO+rC7Ji68ePmgQolfnFY1ol0bjXZrs1fCC1HJAQ2VJNo4Cc0tKZm3lLQ==',key_name='tempest-keypair-955918046',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='510ca3caf6744020a287b409fd087b27',ramdisk_id='',reservation_id='r-9zhb6fro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-486327567',owner_user_name='tempest-VolumesExtendAttachedTest-486327567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:30:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4107107928ee48a0a131a29a2bc03bda',uuid=4b6317aa-80aa-4472-a224-12c1e111fd29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "411fbe6e-4a07-4237-8ab5-32bd2faada30", "address": "fa:16:3e:97:39:15", "network": {"id": "6380647b-f467-4892-a9d3-27c99e541f05", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1742156155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "510ca3caf6744020a287b409fd087b27", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap411fbe6e-4a", "ovs_interfaceid": "411fbe6e-4a07-4237-8ab5-32bd2faada30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:30:54.191315 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Converting VIF {"id": "411fbe6e-4a07-4237-8ab5-32bd2faada30", "address": "fa:16:3e:97:39:15", "network": {"id": "6380647b-f467-4892-a9d3-27c99e541f05", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1742156155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "510ca3caf6744020a287b409fd087b27", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap411fbe6e-4a", "ovs_interfaceid": "411fbe6e-4a07-4237-8ab5-32bd2faada30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:30:54.192403 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:39:15,bridge_name='br-int',has_traffic_filtering=True,id=411fbe6e-4a07-4237-8ab5-32bd2faada30,network=Network(6380647b-f467-4892-a9d3-27c99e541f05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap411fbe6e-4a') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:30:54.193683 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b6317aa-80aa-4472-a224-12c1e111fd29 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] End _get_guest_xml xml= Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: 4b6317aa-80aa-4472-a224-12c1e111fd29 Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: instance-0000006b Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: tempest-VolumesExtendAttachedTest-instance-1336989183 Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:30:54 Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: tempest-VolumesExtendAttachedTest-486327567-project-member Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: tempest-VolumesExtendAttachedTest-486327567 Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: 4b6317aa-80aa-4472-a224-12c1e111fd29 Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: 4b6317aa-80aa-4472-a224-12c1e111fd29 Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: Jan 26 19:30:54.699244 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:30:54.703333 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Preparing to wait for external event network-vif-plugged-411fbe6e-4a07-4237-8ab5-32bd2faada30 {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:30:54.703333 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Acquiring lock "4b6317aa-80aa-4472-a224-12c1e111fd29-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:30:54.703333 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "4b6317aa-80aa-4472-a224-12c1e111fd29-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:30:54.703333 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "4b6317aa-80aa-4472-a224-12c1e111fd29-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:30:54.703333 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:30:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1336989183',display_name='tempest-VolumesExtendAttachedTest-instance-1336989183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-volumesextendattachedtest-instance-1336989183',id=107,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxr0MYFPDiXXMq0IRKiJUx/l5ykTCKCGTax4kV+H9r21+zoktAmCqcTLEYHT9bzLdOMhYOPUkO+rC7Ji68ePmgQolfnFY1ol0bjXZrs1fCC1HJAQ2VJNo4Cc0tKZm3lLQ==',key_name='tempest-keypair-955918046',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='510ca3caf6744020a287b409fd087b27',ramdisk_id='',reservation_id='r-9zhb6fro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-486327567',owner_user_name='tempest-VolumesExtendAttachedTest-486327567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:30:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4107107928ee48a0a131a29a2bc03bda',uuid=4b6317aa-80aa-4472-a224-12c1e111fd29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "411fbe6e-4a07-4237-8ab5-32bd2faada30", "address": "fa:16:3e:97:39:15", "network": {"id": "6380647b-f467-4892-a9d3-27c99e541f05", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1742156155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "510ca3caf6744020a287b409fd087b27", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap411fbe6e-4a", "ovs_interfaceid": "411fbe6e-4a07-4237-8ab5-32bd2faada30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:30:54.703968 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Converting VIF {"id": "411fbe6e-4a07-4237-8ab5-32bd2faada30", "address": "fa:16:3e:97:39:15", "network": {"id": "6380647b-f467-4892-a9d3-27c99e541f05", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1742156155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "510ca3caf6744020a287b409fd087b27", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap411fbe6e-4a", "ovs_interfaceid": "411fbe6e-4a07-4237-8ab5-32bd2faada30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:30:54.704273 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:39:15,bridge_name='br-int',has_traffic_filtering=True,id=411fbe6e-4a07-4237-8ab5-32bd2faada30,network=Network(6380647b-f467-4892-a9d3-27c99e541f05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap411fbe6e-4a') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:30:54.704919 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:39:15,bridge_name='br-int',has_traffic_filtering=True,id=411fbe6e-4a07-4237-8ab5-32bd2faada30,network=Network(6380647b-f467-4892-a9d3-27c99e541f05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap411fbe6e-4a') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:30:54.705571 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:54.706110 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:30:54.706565 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:30:54.707633 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:54.708145 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '474fb81c-58a3-5152-90d9-1d1ff173e994', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:30:54.757599 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:54.760897 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:54.764796 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:54.767673 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap411fbe6e-4a, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:30:54.768472 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap411fbe6e-4a, col_values=(('qos', UUID('7bda8aeb-6fd3-475c-9c47-eda98f14188f')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:30:54.768920 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap411fbe6e-4a, col_values=(('external_ids', {'iface-id': '411fbe6e-4a07-4237-8ab5-32bd2faada30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:39:15', 'vm-uuid': '4b6317aa-80aa-4472-a224-12c1e111fd29'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:30:54.770548 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:54.774897 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:30:54.779602 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:54.781563 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:39:15,bridge_name='br-int',has_traffic_filtering=True,id=411fbe6e-4a07-4237-8ab5-32bd2faada30,network=Network(6380647b-f467-4892-a9d3-27c99e541f05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap411fbe6e-4a') Jan 26 19:30:56.307764 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:30:56.308425 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:30:56.308425 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] No VIF found with MAC fa:16:3e:97:39:15, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:30:56.309343 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Using config drive Jan 26 19:30:56.848613 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:30:56.953168 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Creating config drive at /opt/stack/data/nova/instances/4b6317aa-80aa-4472-a224-12c1e111fd29/disk.config Jan 26 19:30:56.957353 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/4b6317aa-80aa-4472-a224-12c1e111fd29/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp_4dffc2e {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:57.077205 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/4b6317aa-80aa-4472-a224-12c1e111fd29/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmp_4dffc2e" returned: 0 in 0.118s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:57.147104 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:57.156467 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:57.159016 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:57.306377 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-450b69d6-df78-4f26-9cbd-c5dca29a436f req-f47484b0-88a8-45c5-a97a-c6b65e7b26d7 service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Received event network-vif-plugged-411fbe6e-4a07-4237-8ab5-32bd2faada30 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:30:57.306377 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-450b69d6-df78-4f26-9cbd-c5dca29a436f req-f47484b0-88a8-45c5-a97a-c6b65e7b26d7 service nova] Acquiring lock "4b6317aa-80aa-4472-a224-12c1e111fd29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:30:57.306377 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-450b69d6-df78-4f26-9cbd-c5dca29a436f req-f47484b0-88a8-45c5-a97a-c6b65e7b26d7 service nova] Lock "4b6317aa-80aa-4472-a224-12c1e111fd29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:30:57.306480 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-450b69d6-df78-4f26-9cbd-c5dca29a436f req-f47484b0-88a8-45c5-a97a-c6b65e7b26d7 service nova] Lock "4b6317aa-80aa-4472-a224-12c1e111fd29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:30:57.306639 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-450b69d6-df78-4f26-9cbd-c5dca29a436f req-f47484b0-88a8-45c5-a97a-c6b65e7b26d7 service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Processing event network-vif-plugged-411fbe6e-4a07-4237-8ab5-32bd2faada30 {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:30:57.318937 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:30:57.319906 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:30:57.320278 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] VM Started (Lifecycle Event) Jan 26 19:30:57.325023 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:30:57.333375 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Instance spawned successfully. Jan 26 19:30:57.333553 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:30:57.463632 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:57.464870 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:57.469050 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:57.469357 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:57.824433 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:30:57.827008 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:30:57.840881 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:30:57.841068 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:30:57.841398 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:30:57.841674 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:30:57.842019 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:30:57.842289 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:30:58.330962 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:30:58.331534 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:30:58.331534 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] VM Paused (Lifecycle Event) Jan 26 19:30:58.347675 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Took 5.96 seconds to spawn the instance on the hypervisor. Jan 26 19:30:58.347951 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:30:58.644534 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:30:58.834172 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:30:58.836748 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:30:58.836933 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] VM Resumed (Lifecycle Event) Jan 26 19:30:58.859129 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Took 11.19 seconds to build instance. Jan 26 19:30:59.340442 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:30:59.344199 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-53d3c166-9e3a-47c3-96e4-bf53d39c132d req-6fdd35fa-6d67-4780-b05f-c1f2158f4c37 service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Received event network-vif-plugged-411fbe6e-4a07-4237-8ab5-32bd2faada30 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:30:59.344199 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-53d3c166-9e3a-47c3-96e4-bf53d39c132d req-6fdd35fa-6d67-4780-b05f-c1f2158f4c37 service nova] Acquiring lock "4b6317aa-80aa-4472-a224-12c1e111fd29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:30:59.344199 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-53d3c166-9e3a-47c3-96e4-bf53d39c132d req-6fdd35fa-6d67-4780-b05f-c1f2158f4c37 service nova] Lock "4b6317aa-80aa-4472-a224-12c1e111fd29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:30:59.344516 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-53d3c166-9e3a-47c3-96e4-bf53d39c132d req-6fdd35fa-6d67-4780-b05f-c1f2158f4c37 service nova] Lock "4b6317aa-80aa-4472-a224-12c1e111fd29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:30:59.345145 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-53d3c166-9e3a-47c3-96e4-bf53d39c132d req-6fdd35fa-6d67-4780-b05f-c1f2158f4c37 service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] No waiting events found dispatching network-vif-plugged-411fbe6e-4a07-4237-8ab5-32bd2faada30 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:30:59.345650 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-53d3c166-9e3a-47c3-96e4-bf53d39c132d req-6fdd35fa-6d67-4780-b05f-c1f2158f4c37 service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Received unexpected event network-vif-plugged-411fbe6e-4a07-4237-8ab5-32bd2faada30 for instance with vm_state active and task_state None. Jan 26 19:30:59.348880 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:30:59.361262 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-931367d0-cc93-42c6-9b45-a9a7f557c9da tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "4b6317aa-80aa-4472-a224-12c1e111fd29" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 12.704s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:30:59.814407 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:01.379176 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5111f6e8-bc24-43b9-b338-47de55d9dc1d req-8027875c-eaf1-4269-8f63-7e7195659e1d service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Received event network-changed-411fbe6e-4a07-4237-8ab5-32bd2faada30 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:31:01.379176 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5111f6e8-bc24-43b9-b338-47de55d9dc1d req-8027875c-eaf1-4269-8f63-7e7195659e1d service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Refreshing instance network info cache due to event network-changed-411fbe6e-4a07-4237-8ab5-32bd2faada30. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:31:01.379176 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5111f6e8-bc24-43b9-b338-47de55d9dc1d req-8027875c-eaf1-4269-8f63-7e7195659e1d service nova] Acquiring lock "refresh_cache-4b6317aa-80aa-4472-a224-12c1e111fd29" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:31:01.379741 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5111f6e8-bc24-43b9-b338-47de55d9dc1d req-8027875c-eaf1-4269-8f63-7e7195659e1d service nova] Acquired lock "refresh_cache-4b6317aa-80aa-4472-a224-12c1e111fd29" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:31:01.379741 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-5111f6e8-bc24-43b9-b338-47de55d9dc1d req-8027875c-eaf1-4269-8f63-7e7195659e1d service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Refreshing network info cache for port 411fbe6e-4a07-4237-8ab5-32bd2faada30 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:31:01.882911 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-5111f6e8-bc24-43b9-b338-47de55d9dc1d req-8027875c-eaf1-4269-8f63-7e7195659e1d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:31:02.200306 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-5111f6e8-bc24-43b9-b338-47de55d9dc1d req-8027875c-eaf1-4269-8f63-7e7195659e1d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:31:02.299408 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-5111f6e8-bc24-43b9-b338-47de55d9dc1d req-8027875c-eaf1-4269-8f63-7e7195659e1d service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Updated VIF entry in instance network info cache for port 411fbe6e-4a07-4237-8ab5-32bd2faada30. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:31:02.299800 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-5111f6e8-bc24-43b9-b338-47de55d9dc1d req-8027875c-eaf1-4269-8f63-7e7195659e1d service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Updating instance_info_cache with network_info: [{"id": "411fbe6e-4a07-4237-8ab5-32bd2faada30", "address": "fa:16:3e:97:39:15", "network": {"id": "6380647b-f467-4892-a9d3-27c99e541f05", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1742156155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "510ca3caf6744020a287b409fd087b27", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap411fbe6e-4a", "ovs_interfaceid": "411fbe6e-4a07-4237-8ab5-32bd2faada30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:31:02.803923 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-5111f6e8-bc24-43b9-b338-47de55d9dc1d req-8027875c-eaf1-4269-8f63-7e7195659e1d service nova] Releasing lock "refresh_cache-4b6317aa-80aa-4472-a224-12c1e111fd29" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:31:03.646929 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:04.857861 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:08.647840 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:09.894662 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:13.648290 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:14.897003 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:18.650857 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:19.899433 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:23.653541 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:24.902913 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:26.539002 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Acquiring lock "4b6317aa-80aa-4472-a224-12c1e111fd29" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:31:26.539690 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "4b6317aa-80aa-4472-a224-12c1e111fd29" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:31:27.050574 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lazy-loading 'flavor' on Instance uuid 4b6317aa-80aa-4472-a224-12c1e111fd29 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:31:27.555099 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Ignoring supplied device name: /dev/vdb Jan 26 19:31:28.059060 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "4b6317aa-80aa-4472-a224-12c1e111fd29" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.519s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:31:28.654509 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:29.151910 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Acquiring lock "4b6317aa-80aa-4472-a224-12c1e111fd29" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:31:29.152203 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "4b6317aa-80aa-4472-a224-12c1e111fd29" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:31:29.152596 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Attaching volume 896e6195-bbfa-448e-8fae-1666bf29c11b to /dev/vdb Jan 26 19:31:29.200058 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': True, 'host': 'np0005596550.novalocal', 'execute': None}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:31:29.201202 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:29.210014 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:29.210167 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[055de75d-0266-4cc5-8e07-375b649be356]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:29.213498 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[acd651e5-b4d4-49d3-b2bd-e260fe840e4d]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:31:29.213498 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:31:29.213498 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:31:29.213498 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:31:29.213498 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:31:29.213498 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:31:29.213498 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:31:29.213498 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:31:29.213498 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:31:29.213498 np0005596550.novalocal nova-compute[189076]: with open_scini_device() as fd: Jan 26 19:31:29.213498 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:31:29.213498 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:31:29.213498 np0005596550.novalocal nova-compute[189076]: return next(self.gen) Jan 26 19:31:29.213498 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^ Jan 26 19:31:29.213498 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:31:29.213498 np0005596550.novalocal nova-compute[189076]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:31:29.213498 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:31:29.213498 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:31:29.214161 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd651e5-b4d4-49d3-b2bd-e260fe840e4d]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:29.214539 np0005596550.novalocal nova-compute[189076]: ERROR os_brick.initiator.connectors.scaleio [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:31:29.214722 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.scaleio [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:31:29.216575 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:29.225033 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:29.225205 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f9111d-d35e-4e70-b5f3-b8ad1108d67d]: (4, ('/dev/vda2\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:29.226063 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:29.241415 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.015s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:29.241576 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c83a14-98ed-4086-90d5-11b66d354039]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:29.242826 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b57ff22-b8ec-4213-94a5-8861de4660dc]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:29.243126 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Running cmd (subprocess): nvme version {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:29.260011 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] 'nvme version' failed. Not Retrying. {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:31:29.260272 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] nvme not present on system {{(pid=189076) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:31:29.261909 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=189076) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:31:29.262855 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.lightos [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fe97:3915', 'fe80::41c:41ff:febe:5a76'] Jan 26 19:31:29.263002 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:31:29.263141 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.lightos [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=189076) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:31:29.263420 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] <== get_connector_properties: return (62ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': True, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fe97:3915', 'fe80::41c:41ff:febe:5a76']} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:31:29.263642 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.block_device [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Updating existing volume attachment record: d052b3f7-4370-498d-8a70-378927c884e5 {{(pid=189076) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jan 26 19:31:29.904571 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:30.896056 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:31:32.818064 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Calling os-brick to attach iSCSI Volume {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jan 26 19:31:32.818921 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b', 'target_lun': 0, 'volume_id': '896e6195-bbfa-448e-8fae-1666bf29c11b', 'auth_method': 'CHAP', 'auth_username': 'LnKR85TrnPNFFd3uekTd', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:31:32.819163 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:31:32.821818 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:31:32.821818 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b', 'target_lun': 0, 'volume_id': '896e6195-bbfa-448e-8fae-1666bf29c11b', 'auth_method': 'CHAP', 'auth_username': 'LnKR85TrnPNFFd3uekTd', 'auth_password': '7Hr9TrM53We8W4CR', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True} {{(pid=189076) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:31:32.821818 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:32.827740 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:31:32.829823 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[2010ed8a-a2ad-4954-9c2c-31ca6ee53e0f]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:31:32.829823 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:31:32.829823 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:31:32.829823 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:31:32.829823 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:31:32.829823 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:31:32.829823 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:31:32.829823 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:31:32.829823 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:31:32.829823 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:31:32.829823 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:31:32.829823 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:31:32.829823 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:31:32.829823 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:31:32.829823 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:31:32.829823 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:31:32.829823 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:31:32.829823 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:31:32.829823 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:31:32.829823 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:31:32.829823 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:31:32.829823 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:31:32.833233 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[2010ed8a-a2ad-4954-9c2c-31ca6ee53e0f]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:32.833233 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:31:32.833233 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:31:32.833233 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:31:32.834846 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:32.847755 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260" returned: 21 in 0.013s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:32.848049 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f4c2e2-8b3c-4ad3-bab7-0143ec7c756c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:32.848403 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:31:32.848403 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:31:32.850061 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260 --interface default --op new {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:32.860991 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:32.861190 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a52df39-b1a6-4411-9a6d-021214cab7f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:32.861511 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b] added Jan 26 19:31:32.861511 np0005596550.novalocal nova-compute[189076]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:31:32.861511 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:31:32.861511 np0005596550.novalocal nova-compute[189076]: iscsiadm: Config file line 381 does not have value Jan 26 19:31:32.861511 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:31:32.861704 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=189076) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:31:32.862031 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.029(s), this was the 1st time calling it. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:31:32.862357 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.utils [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=189076) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:31:33.863607 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:31:33.864581 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:33.874590 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:33.874813 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dd2703-977d-46a6-8bc1-8d8b6b8951a2]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.name = iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.tpgt = -1 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.startup = automatic Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.leading_login = No Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.iscsi_ifacename = default Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.net_ifacename = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.ipaddress = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.prefix_len = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.hwaddress = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.transport_name = tcp Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.initiatorname = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.state = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.vlan_id = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.vlan_priority = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.vlan_state = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.iface_num = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.mtu = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.port = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.bootproto = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.subnet_mask = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.gateway = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id_state = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.dhcp_alt_client_id = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.dhcp_dns = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.dhcp_learn_iqn = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.dhcp_req_vendor_id_state = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id_state = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.dhcp_vendor_id = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.dhcp_slp_da = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.fragmentation = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.gratuitous_arp = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.incoming_forwarding = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.tos_state = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.tos = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.ttl = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.delayed_ack = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.tcp_nagle = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf_state = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.tcp_wsf = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.tcp_timer_scale = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.tcp_timestamp = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.redirect = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.def_task_mgmt_timeout = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.header_digest = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.data_digest = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.immediate_data = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.initial_r2t = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.data_seq_inorder = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.data_pdu_inorder = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.erl = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.max_receive_data_len = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.first_burst_len = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.max_outstanding_r2t = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.max_burst_len = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.chap_auth = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.bidi_chap = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.strict_login_compliance = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.discovery_auth = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: iface.discovery_logout = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.discovery_address = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.discovery_port = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.discovery_type = fw Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.initial_cmdsn = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.initial_login_retry_max = 8 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.xmit_thread_priority = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.cmds_max = 128 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.queue_depth = 32 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.nr_sessions = 1 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.auth.authmethod = None Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.auth.username = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.auth.password = *** Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.auth.username_in = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.auth.password_in = Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.timeo.replacement_timeout = 120 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FastAbort = Yes Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.InitialR2T = No Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ImmediateData = Yes Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxConnections = 1 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.iscsi.ERL = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.scan = auto Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.reopen_max = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.session.conn_reopen_log_freq = 1 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.conn[0].address = 38.102.83.18 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.conn[0].port = 3260 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.conn[0].startup = manual Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.window_size = 524288 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.DataDigest = None Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.IFMarker = No Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: node.conn[0].iscsi.OFMarker = No Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: # END RECORD Jan 26 19:31:33.875883 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:31:33.879180 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:33.883628 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:33.883827 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2b01b1-e547-48ee-8bdc-8ee663b0d55d]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:33.884195 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:31:33.885431 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:33.939701 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.054s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:33.939877 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaef370f-2bbd-43d0-bac5-056dd4f9d51b]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:33.940229 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:31:33.941348 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260 --op update -n node.session.auth.username -v LnKR85TrnPNFFd3uekTd {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:33.951936 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260 --op update -n node.session.auth.username -v LnKR85TrnPNFFd3uekTd" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:33.952048 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf2d07b-00fa-4fd1-8209-0a6372490300]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:33.952353 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LnKR85TrnPNFFd3uekTd'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:31:33.954048 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:33.966401 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.012s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:33.966726 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[edda8730-d797-49ee-a147-fc7e3bde6a49]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:33.967581 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:31:33.968862 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:33.977269 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:33.977601 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3eab1c-2adf-497e-be48-9bf85d55186a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:33.978140 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jan 26 19:31:33.978140 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:31:33.978591 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jan 26 19:31:33.978591 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:31:33.978943 np0005596550.novalocal nova-compute[189076]: WARNING os_brick.initiator.connectors.iscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jan 26 19:31:33.978943 np0005596550.novalocal nova-compute[189076]: Jan 26 19:31:33.980336 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260 --login {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:33.996466 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260 --login" returned: 0 in 0.015s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:33.996466 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b25db16-d411-4448-8299-099f3928aa05]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:33.996867 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b, portal: 38.102.83.18,3260] successful. Jan 26 19:31:33.996867 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:31:33.998891 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:34.010344 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:34.010592 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[41720330-af84-41bb-9419-6aa32449d50f]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:34.011146 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:31:34.012214 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:34.021937 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:34.022215 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5b5845-c76a-4d83-9562-c3c66d32b6bf]: (4, ('tcp: [33] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:34.022537 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b (non-flash) Jan 26 19:31:34.022537 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:31:34.022748 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] iscsi session list stdout=tcp: [33] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b (non-flash) Jan 26 19:31:34.022748 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:31:34.023169 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:31:34.023399 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Connected to 38.102.83.18:3260 {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:31:34.024004 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] HCTL ('2', '-', '-', 0) found on session 33 with lun 0 {{(pid=189076) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:31:34.024220 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Scanning host 2 c: -, t: -, l: 0) {{(pid=189076) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:31:34.025121 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host2/scan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:34.074242 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host2/scan" returned: 0 in 0.049s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:34.074401 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[f492d9a9-a553-4123-9bf8-001e07983cbc]: (4, ('- - 0', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:34.075207 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Searching for a device in session 33 and hctl ['2', '*', '*', 0] yield: None {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:31:34.906356 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:31:34.907795 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:34.908085 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:31:34.908553 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:31:34.908756 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:31:34.909222 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:35.076893 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Searching for a device in session 33 and hctl ['2', '*', '*', 0] yield: sda {{(pid=189076) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:31:35.077714 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Connected to sda using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b', 'target_lun': 0, 'volume_id': '896e6195-bbfa-448e-8fae-1666bf29c11b', 'auth_method': 'CHAP', 'auth_username': 'LnKR85TrnPNFFd3uekTd', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': True} {{(pid=189076) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:31:35.078727 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.259s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:31:35.079135 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] <== connect_volume: return (2260ms) {'type': 'block', 'scsi_wwn': '360014057815efaaab0c468dba0f549e8', 'path': '/dev/sda'} {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:31:35.079475 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '360014057815efaaab0c468dba0f549e8', 'path': '/dev/sda'} {{(pid=189076) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jan 26 19:31:35.084634 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lazy-loading 'flavor' on Instance uuid 4b6317aa-80aa-4472-a224-12c1e111fd29 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:31:35.592673 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] attach device xml: Jan 26 19:31:35.592673 np0005596550.novalocal nova-compute[189076]: Jan 26 19:31:35.592673 np0005596550.novalocal nova-compute[189076]: Jan 26 19:31:35.592673 np0005596550.novalocal nova-compute[189076]: Jan 26 19:31:35.592673 np0005596550.novalocal nova-compute[189076]: Jan 26 19:31:35.592673 np0005596550.novalocal nova-compute[189076]: 896e6195-bbfa-448e-8fae-1666bf29c11b Jan 26 19:31:35.592673 np0005596550.novalocal nova-compute[189076]: Jan 26 19:31:35.592673 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:330}} Jan 26 19:31:37.318094 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:31:37.318478 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] No BDM found with device name vdb, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:31:37.318646 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:31:37.318982 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] No VIF found with MAC fa:16:3e:97:39:15, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:31:38.881234 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-8c5e5ee2-6426-4d74-a0a3-f4264c1ec71c tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "4b6317aa-80aa-4472-a224-12c1e111fd29" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 9.729s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:31:38.896011 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:31:38.896713 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:31:39.403577 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:31:39.403577 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:31:39.403754 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:31:39.403835 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:31:39.910408 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:31:39.911681 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:39.911908 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:31:39.912086 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:31:39.912624 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:31:39.913080 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:40.306176 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Received event volume-extended-896e6195-bbfa-448e-8fae-1666bf29c11b {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:31:40.431165 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b6317aa-80aa-4472-a224-12c1e111fd29/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:40.532871 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b6317aa-80aa-4472-a224-12c1e111fd29/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:40.535212 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b6317aa-80aa-4472-a224-12c1e111fd29/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:40.625223 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b6317aa-80aa-4472-a224-12c1e111fd29/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:40.625606 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] skipping disk /dev/sda (vdb) as it is a volume {{(pid=189076) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12209}} Jan 26 19:31:40.696084 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:31:40.696961 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:40.711786 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.015s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:40.712048 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=7385MB free_disk=371.6816864013672GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:31:40.712180 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:31:40.712418 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:31:40.809845 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Handling volume-extended event for volume 896e6195-bbfa-448e-8fae-1666bf29c11b {{(pid=189076) extend_volume /opt/stack/nova/nova/compute/manager.py:11711}} Jan 26 19:31:41.312252 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Cinder extended volume 896e6195-bbfa-448e-8fae-1666bf29c11b; extending it to detect new size Jan 26 19:31:41.776934 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 4b6317aa-80aa-4472-a224-12c1e111fd29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:31:41.777289 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 1 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:31:41.777595 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=704MB phys_disk=399GB used_disk=1GB total_vcpus=8 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:31:40 up 59 min, 13 users, load average: 1.52, 1.78, 2.85\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_510ca3caf6744020a287b409fd087b27': '1', 'io_workload': '0'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:31:41.839123 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] calling os-brick to extend iSCSI Volume {{(pid=189076) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:88}} Jan 26 19:31:41.840060 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] ==> extend_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b', 'target_lun': 0, 'volume_id': '896e6195-bbfa-448e-8fae-1666bf29c11b', 'auth_method': 'CHAP', 'auth_username': 'LnKR85TrnPNFFd3uekTd', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sda': {}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:31:41.840344 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] Acquiring lock "extend_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:31:41.840982 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] Lock "extend_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:31:41.841577 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] Extend volume for {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b', 'target_lun': 0, 'volume_id': '896e6195-bbfa-448e-8fae-1666bf29c11b', 'auth_method': 'CHAP', 'auth_username': 'LnKR85TrnPNFFd3uekTd', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sda'} Jan 26 19:31:41.841807 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] Multipath discovery for iSCSI not enabled. Jan 26 19:31:41.845009 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:41.859129 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.015s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:41.859274 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c87b69-4f90-4dc8-96f0-a862328380b3]: (4, ('tcp: [33] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:41.859645 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] iscsiadm ('-m', 'session'): stdout=tcp: [33] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b (non-flash) Jan 26 19:31:41.859645 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:31:41.859859 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] iscsi session list stdout=tcp: [33] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b (non-flash) Jan 26 19:31:41.859859 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:31:41.860411 np0005596550.novalocal nova-compute[189076]: INFO os_brick.initiator.connectors.iscsi [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] Found paths for volume ['/dev/disk/by-path/ip-38.102.83.18:3260-iscsi-iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b-lun-0'] Jan 26 19:31:41.860634 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] Checking paths are valid ['/dev/disk/by-path/ip-38.102.83.18:3260-iscsi-iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b-lun-0'] {{(pid=189076) extend_volume /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:713}} Jan 26 19:31:41.861637 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): dd if=/dev/disk/by-path/ip-38.102.83.18:3260-iscsi-iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b-lun-0 of=/dev/null count=1 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:41.865056 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:31:41.872338 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "dd if=/dev/disk/by-path/ip-38.102.83.18:3260-iscsi-iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b-lun-0 of=/dev/null count=1" returned: 0 in 0.010s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:41.872338 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b440f2-6ddd-4ce5-bc8a-46b8590f6714]: (4, ('', '1+0 records in\n1+0 records out\n512 bytes copied, 0.000436953 s, 1.2 MB/s\n')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:41.872338 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] extend volume ['/dev/disk/by-path/ip-38.102.83.18:3260-iscsi-iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b-lun-0'] {{(pid=189076) extend_volume /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:720}} Jan 26 19:31:41.872650 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] Running cmd (subprocess): lsscsi {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:41.892888 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] CMD "lsscsi" returned: 0 in 0.020s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:41.893439 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] dev_info={'device': '/dev/disk/by-path/ip-38.102.83.18:3260-iscsi-iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b-lun-0', 'host': '2', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=189076) get_device_info /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:203}} Jan 26 19:31:41.893733 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] Volume device info = {'device': '/dev/disk/by-path/ip-38.102.83.18:3260-iscsi-iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b-lun-0', 'host': '2', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=189076) extend_volume /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:724}} Jan 26 19:31:41.895257 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --getsize64 /dev/disk/by-path/ip-38.102.83.18:3260-iscsi-iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b-lun-0 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:41.903071 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --getsize64 /dev/disk/by-path/ip-38.102.83.18:3260-iscsi-iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b-lun-0" returned: 0 in 0.008s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:41.903258 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25145cc-116b-4467-9742-725024391978]: (4, ('1073741824\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:41.903884 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] Starting size: 1073741824 {{(pid=189076) extend_volume /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:735}} Jan 26 19:31:41.904718 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/bus/scsi/drivers/sd/2:0:0:0/rescan {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:41.951186 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/bus/scsi/drivers/sd/2:0:0:0/rescan" returned: 0 in 0.046s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:41.951392 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad05da6b-a78f-46da-a6fd-1df5e9cdcf62]: (4, ('1', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:41.953085 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --getsize64 /dev/disk/by-path/ip-38.102.83.18:3260-iscsi-iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b-lun-0 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:41.960435 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --getsize64 /dev/disk/by-path/ip-38.102.83.18:3260-iscsi-iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b-lun-0" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:41.960435 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dddb2e-fccf-4c5b-b8b9-620bd14a5b08]: (4, ('2147483648\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:41.960590 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] volume size after scsi device rescan 2147483648 {{(pid=189076) extend_volume /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:741}} Jan 26 19:31:41.961788 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): /lib/udev/scsi_id --page 0x83 --whitelisted /dev/disk/by-path/ip-38.102.83.18:3260-iscsi-iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b-lun-0 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:41.978093 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "/lib/udev/scsi_id --page 0x83 --whitelisted /dev/disk/by-path/ip-38.102.83.18:3260-iscsi-iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b-lun-0" returned: 0 in 0.016s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:41.978272 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e94dea-da23-44c5-87c3-bf9cf25f6016]: (4, ('360014057815efaaab0c468dba0f549e8\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:41.978915 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] Lock "extend_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: held 0.138s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:31:41.979139 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] <== extend_volume: return (138ms) 2147483648 {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:31:41.979403 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Extend iSCSI Volume: new_size=2147483648 {{(pid=189076) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:90}} Jan 26 19:31:41.982744 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [req-5d764d16-6a50-404b-9a6e-9148b5f89e28 req-fe72cebf-2d69-4eb0-8433-d74428038f3b service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Resizing target device /dev/sda to 2147483648 {{(pid=189076) _resize_attached_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2899}} Jan 26 19:31:42.369542 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:31:42.879637 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:31:42.880023 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.167s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:31:43.223519 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Acquiring lock "4b6317aa-80aa-4472-a224-12c1e111fd29" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:31:43.223945 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "4b6317aa-80aa-4472-a224-12c1e111fd29" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:31:43.728848 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Detaching volume 896e6195-bbfa-448e-8fae-1666bf29c11b Jan 26 19:31:43.773145 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.block_device [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Attempting to driver detach volume 896e6195-bbfa-448e-8fae-1666bf29c11b from mountpoint /dev/vdb Jan 26 19:31:43.781799 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Found disk vdb by alias ua-896e6195-bbfa-448e-8fae-1666bf29c11b {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:31:43.783537 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Found disk vdb by alias ua-896e6195-bbfa-448e-8fae-1666bf29c11b {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:31:43.783731 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Attempting to detach device vdb from instance 4b6317aa-80aa-4472-a224-12c1e111fd29 from the persistent domain config. {{(pid=189076) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2599}} Jan 26 19:31:43.784106 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] detach device xml: Jan 26 19:31:43.784106 np0005596550.novalocal nova-compute[189076]: Jan 26 19:31:43.784106 np0005596550.novalocal nova-compute[189076]: Jan 26 19:31:43.784106 np0005596550.novalocal nova-compute[189076]: Jan 26 19:31:43.784106 np0005596550.novalocal nova-compute[189076]: Jan 26 19:31:43.784106 np0005596550.novalocal nova-compute[189076]: 896e6195-bbfa-448e-8fae-1666bf29c11b Jan 26 19:31:43.784106 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:31:43.784106 np0005596550.novalocal nova-compute[189076]: Jan 26 19:31:43.784106 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:31:43.903292 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Found disk vdb by alias ua-896e6195-bbfa-448e-8fae-1666bf29c11b {{(pid=189076) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2848}} Jan 26 19:31:43.903606 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Failed to detach device vdb from instance 4b6317aa-80aa-4472-a224-12c1e111fd29 from the persistent domain config. Libvirt did not report any error but the device is still in the config. Jan 26 19:31:43.903991 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] (1/8): Attempting to detach device vdb with device alias ua-896e6195-bbfa-448e-8fae-1666bf29c11b from instance 4b6317aa-80aa-4472-a224-12c1e111fd29 from the live domain config. {{(pid=189076) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2633}} Jan 26 19:31:43.904536 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] detach device xml: Jan 26 19:31:43.904536 np0005596550.novalocal nova-compute[189076]: Jan 26 19:31:43.904536 np0005596550.novalocal nova-compute[189076]: Jan 26 19:31:43.904536 np0005596550.novalocal nova-compute[189076]: Jan 26 19:31:43.904536 np0005596550.novalocal nova-compute[189076]: Jan 26 19:31:43.904536 np0005596550.novalocal nova-compute[189076]: 896e6195-bbfa-448e-8fae-1666bf29c11b Jan 26 19:31:43.904536 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:31:43.904536 np0005596550.novalocal nova-compute[189076]: Jan 26 19:31:43.904536 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:31:44.034679 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Received event ua-896e6195-bbfa-448e-8fae-1666bf29c11b> from libvirt while the driver is waiting for it; dispatched. {{(pid=189076) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2486}} Jan 26 19:31:44.035873 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-896e6195-bbfa-448e-8fae-1666bf29c11b for instance 4b6317aa-80aa-4472-a224-12c1e111fd29 {{(pid=189076) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2713}} Jan 26 19:31:44.039263 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Successfully detached device vdb from instance 4b6317aa-80aa-4472-a224-12c1e111fd29 from the live domain config. Jan 26 19:31:44.040826 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] calling os-brick to detach iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jan 26 19:31:44.041425 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b', 'target_lun': 0, 'volume_id': '896e6195-bbfa-448e-8fae-1666bf29c11b', 'auth_method': 'CHAP', 'auth_username': 'LnKR85TrnPNFFd3uekTd', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/sda'}, None), 'kwargs': False}}" {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:31:44.041582 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:31:44.041925 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:31:44.042809 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:44.050418 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.007s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:44.050707 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c578f8-c1ca-42eb-8a25-10df3b95e7b1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:44.050986 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:31:44.050986 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:31:44.050986 np0005596550.novalocal nova-compute[189076]: iSNS: Jan 26 19:31:44.050986 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:31:44.050986 np0005596550.novalocal nova-compute[189076]: STATIC: Jan 26 19:31:44.050986 np0005596550.novalocal nova-compute[189076]: Target: iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b Jan 26 19:31:44.050986 np0005596550.novalocal nova-compute[189076]: Portal: 38.102.83.18:3260,-1 Jan 26 19:31:44.050986 np0005596550.novalocal nova-compute[189076]: Iface Name: default Jan 26 19:31:44.050986 np0005596550.novalocal nova-compute[189076]: FIRMWARE: Jan 26 19:31:44.050986 np0005596550.novalocal nova-compute[189076]: No targets found. Jan 26 19:31:44.050986 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:31:44.051186 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:31:44.051186 np0005596550.novalocal nova-compute[189076]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:31:44.051186 np0005596550.novalocal nova-compute[189076]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=189076) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:31:44.051319 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b', 0)] {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:31:44.051998 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:44.058196 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.006s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:44.058374 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[935b6d39-d93a-45e9-8d43-de84b2506287]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:44.058960 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:44.065416 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.006s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:44.065560 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ec83fd-0ce5-42b6-b963-51855977d7c5]: (4, ('tcp: [33] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b (non-flash)\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:44.065939 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b (non-flash) Jan 26 19:31:44.065939 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:31:44.066119 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] iscsi session list stdout=tcp: [33] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b (non-flash) Jan 26 19:31:44.066119 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:31:44.068161 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Resulting device map defaultdict(. at 0x7fd7507c4fe0>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b'): ({'sda'}, set())}) {{(pid=189076) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:31:44.068348 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Removing single pathed devices sda {{(pid=189076) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:31:44.068868 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:44.073822 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:31:44.074818 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[3560e89a-1283-4e10-8bcb-ed403fc50775]: [Errno 2] No such file or directory: 'multipathd' {{(pid=211097) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:31:44.074818 np0005596550.novalocal nova-compute[189076]: Traceback (most recent call last): Jan 26 19:31:44.074818 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:31:44.074818 np0005596550.novalocal nova-compute[189076]: ret = func(*f_args, **f_kwargs) Jan 26 19:31:44.074818 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:31:44.074818 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:31:44.074818 np0005596550.novalocal nova-compute[189076]: return func(*args, **kwargs) Jan 26 19:31:44.074818 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:31:44.074818 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:31:44.074818 np0005596550.novalocal nova-compute[189076]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:31:44.074818 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:31:44.074818 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:31:44.074818 np0005596550.novalocal nova-compute[189076]: return putils.execute(on_execute=on_execute, Jan 26 19:31:44.074818 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:31:44.074818 np0005596550.novalocal nova-compute[189076]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:31:44.074818 np0005596550.novalocal nova-compute[189076]: obj = subprocess.Popen(cmd, Jan 26 19:31:44.074818 np0005596550.novalocal nova-compute[189076]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:31:44.074818 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:31:44.074818 np0005596550.novalocal nova-compute[189076]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:31:44.074818 np0005596550.novalocal nova-compute[189076]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:31:44.074818 np0005596550.novalocal nova-compute[189076]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:31:44.074818 np0005596550.novalocal nova-compute[189076]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:31:44.075608 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[3560e89a-1283-4e10-8bcb-ed403fc50775]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:44.076063 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Flushing IO for device /dev/sda {{(pid=189076) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:31:44.076632 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sda {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:44.082060 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sda" returned: 0 in 0.005s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:44.082185 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bfbbd6-9cc2-4c60-b947-6658e1963768]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:44.082416 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Remove SCSI device /dev/sda with /sys/block/sda/device/delete {{(pid=189076) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:31:44.082989 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sda/device/delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:44.137107 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sda/device/delete" returned: 0 in 0.053s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:44.137498 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[3befe2a9-09e2-4440-b503-15b02bbb9373]: (4, ('1', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:44.138318 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Checking to see if SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:31:44.138823 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.linuxscsi [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] SCSI volumes sda have been removed. {{(pid=189076) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:31:44.139373 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b')] {{(pid=189076) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:31:44.140497 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:44.149292 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.009s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:44.149700 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[05af9662-a3fc-49a4-aa57-2c4a51c110eb]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:44.150403 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:31:44.151815 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260 --logout {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:44.181815 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260 --logout" returned: 0 in 0.029s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:44.182106 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[014d038f-9012-4baa-8dae-e6b5e19c2d9c]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b, portal: 38.102.83.18,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:44.182543 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b, portal: 38.102.83.18,3260] Jan 26 19:31:44.182543 np0005596550.novalocal nova-compute[189076]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b, portal: 38.102.83.18,3260] successful. Jan 26 19:31:44.182543 np0005596550.novalocal nova-compute[189076]: stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:31:44.183730 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260 --op delete {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:31:44.195024 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-896e6195-bbfa-448e-8fae-1666bf29c11b -p 38.102.83.18:3260 --op delete" returned: 0 in 0.011s {{(pid=211097) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:31:44.195318 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.privsep.daemon [-] privsep: reply[235df0ef-45ed-493e-952d-c66e7330cd49]: (4, ('', '')) {{(pid=211097) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:31:44.195865 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=189076) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:31:44.196346 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.base [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.154s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:31:44.196653 np0005596550.novalocal nova-compute[189076]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] <== disconnect_volume: return (154ms) None {{(pid=189076) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:31:44.197000 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Disconnected iSCSI Volume {{(pid=189076) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jan 26 19:31:44.914564 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:31:44.915518 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:44.915669 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:31:44.915816 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:31:44.916459 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:31:44.916560 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:45.879317 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:31:45.879498 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:31:45.879623 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:31:45.879756 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:31:45.879909 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:31:47.262710 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lazy-loading 'flavor' on Instance uuid 4b6317aa-80aa-4472-a224-12c1e111fd29 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:31:48.274455 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a1870588-18e0-4762-b10c-204c9af8a75d tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "4b6317aa-80aa-4472-a224-12c1e111fd29" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 5.050s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:31:48.549005 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Acquiring lock "4b6317aa-80aa-4472-a224-12c1e111fd29" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:31:48.549261 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "4b6317aa-80aa-4472-a224-12c1e111fd29" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:31:48.549648 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Acquiring lock "4b6317aa-80aa-4472-a224-12c1e111fd29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:31:48.550004 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "4b6317aa-80aa-4472-a224-12c1e111fd29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:31:48.550293 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "4b6317aa-80aa-4472-a224-12c1e111fd29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:31:48.553397 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Terminating instance Jan 26 19:31:49.058616 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Start destroying the instance on the hypervisor. {{(pid=189076) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3225}} Jan 26 19:31:49.122938 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:49.125851 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:49.133879 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:49.148375 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:49.156420 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:49.239758 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ef489ca3-b045-4845-8c99-eadc9cd87850 req-a5906772-3fa5-46d1-9ca1-4317101b7cfe service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Received event network-vif-unplugged-411fbe6e-4a07-4237-8ab5-32bd2faada30 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:31:49.240017 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ef489ca3-b045-4845-8c99-eadc9cd87850 req-a5906772-3fa5-46d1-9ca1-4317101b7cfe service nova] Acquiring lock "4b6317aa-80aa-4472-a224-12c1e111fd29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:31:49.240205 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ef489ca3-b045-4845-8c99-eadc9cd87850 req-a5906772-3fa5-46d1-9ca1-4317101b7cfe service nova] Lock "4b6317aa-80aa-4472-a224-12c1e111fd29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:31:49.240344 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-ef489ca3-b045-4845-8c99-eadc9cd87850 req-a5906772-3fa5-46d1-9ca1-4317101b7cfe service nova] Lock "4b6317aa-80aa-4472-a224-12c1e111fd29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:31:49.240482 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ef489ca3-b045-4845-8c99-eadc9cd87850 req-a5906772-3fa5-46d1-9ca1-4317101b7cfe service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] No waiting events found dispatching network-vif-unplugged-411fbe6e-4a07-4237-8ab5-32bd2faada30 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:31:49.240647 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ef489ca3-b045-4845-8c99-eadc9cd87850 req-a5906772-3fa5-46d1-9ca1-4317101b7cfe service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Received event network-vif-unplugged-411fbe6e-4a07-4237-8ab5-32bd2faada30 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:31:49.282717 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:49.290713 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:49.322577 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Instance destroyed successfully. Jan 26 19:31:49.322958 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lazy-loading 'resources' on Instance uuid 4b6317aa-80aa-4472-a224-12c1e111fd29 {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:31:49.398381 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:49.825944 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:30:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1336989183',display_name='tempest-VolumesExtendAttachedTest-instance-1336989183',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-volumesextendattachedtest-instance-1336989183',id=107,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxr0MYFPDiXXMq0IRKiJUx/l5ykTCKCGTax4kV+H9r21+zoktAmCqcTLEYHT9bzLdOMhYOPUkO+rC7Ji68ePmgQolfnFY1ol0bjXZrs1fCC1HJAQ2VJNo4Cc0tKZm3lLQ==',key_name='tempest-keypair-955918046',keypairs=,launch_index=0,launched_at=2026-01-27T00:30:58Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='510ca3caf6744020a287b409fd087b27',ramdisk_id='',reservation_id='r-9zhb6fro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesExtendAttachedTest-486327567',owner_user_name='tempest-VolumesExtendAttachedTest-486327567-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:30:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4107107928ee48a0a131a29a2bc03bda',uuid=4b6317aa-80aa-4472-a224-12c1e111fd29,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "411fbe6e-4a07-4237-8ab5-32bd2faada30", "address": "fa:16:3e:97:39:15", "network": {"id": "6380647b-f467-4892-a9d3-27c99e541f05", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1742156155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "510ca3caf6744020a287b409fd087b27", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap411fbe6e-4a", "ovs_interfaceid": "411fbe6e-4a07-4237-8ab5-32bd2faada30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:839}} Jan 26 19:31:49.826211 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Converting VIF {"id": "411fbe6e-4a07-4237-8ab5-32bd2faada30", "address": "fa:16:3e:97:39:15", "network": {"id": "6380647b-f467-4892-a9d3-27c99e541f05", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1742156155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "510ca3caf6744020a287b409fd087b27", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap411fbe6e-4a", "ovs_interfaceid": "411fbe6e-4a07-4237-8ab5-32bd2faada30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:31:49.826865 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:39:15,bridge_name='br-int',has_traffic_filtering=True,id=411fbe6e-4a07-4237-8ab5-32bd2faada30,network=Network(6380647b-f467-4892-a9d3-27c99e541f05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap411fbe6e-4a') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:31:49.827168 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:39:15,bridge_name='br-int',has_traffic_filtering=True,id=411fbe6e-4a07-4237-8ab5-32bd2faada30,network=Network(6380647b-f467-4892-a9d3-27c99e541f05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap411fbe6e-4a') {{(pid=189076) unplug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:109}} Jan 26 19:31:49.828631 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:49.829001 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap411fbe6e-4a, bridge=br-int, if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:31:49.830137 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:49.832121 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:49.832849 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:49.833022 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7bda8aeb-6fd3-475c-9c47-eda98f14188f) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:31:49.833578 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:49.835148 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:49.837659 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:39:15,bridge_name='br-int',has_traffic_filtering=True,id=411fbe6e-4a07-4237-8ab5-32bd2faada30,network=Network(6380647b-f467-4892-a9d3-27c99e541f05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap411fbe6e-4a') Jan 26 19:31:49.838085 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Deleting instance files /opt/stack/data/nova/instances/4b6317aa-80aa-4472-a224-12c1e111fd29_del Jan 26 19:31:49.838616 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Deletion of /opt/stack/data/nova/instances/4b6317aa-80aa-4472-a224-12c1e111fd29_del complete Jan 26 19:31:49.892137 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:31:50.351476 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Took 1.29 seconds to destroy the instance on the hypervisor. Jan 26 19:31:50.352189 np0005596550.novalocal nova-compute[189076]: DEBUG oslo.service.backend._common.loopingcall [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=189076) func /usr/local/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jan 26 19:31:50.352707 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [-] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Deallocating network for instance {{(pid=189076) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2351}} Jan 26 19:31:50.353067 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] deallocate_for_instance() {{(pid=189076) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jan 26 19:31:50.353680 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:31:50.432608 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:31:51.129753 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ddf8fea7-67b0-493e-9ca4-cfbd4698d7c3 req-eb756fb7-72b4-4b1d-ac03-f38b9a78b1db service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Received event network-vif-deleted-411fbe6e-4a07-4237-8ab5-32bd2faada30 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:31:51.130069 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [req-ddf8fea7-67b0-493e-9ca4-cfbd4698d7c3 req-eb756fb7-72b4-4b1d-ac03-f38b9a78b1db service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Neutron deleted interface 411fbe6e-4a07-4237-8ab5-32bd2faada30; detaching it from the instance and deleting it from the info cache Jan 26 19:31:51.130283 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-ddf8fea7-67b0-493e-9ca4-cfbd4698d7c3 req-eb756fb7-72b4-4b1d-ac03-f38b9a78b1db service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:31:51.272606 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6d9a04ab-7d68-44dc-9e8d-7964d51316db req-38ef3eaf-cdf9-4f47-964f-029723f5a2d2 service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Received event network-vif-unplugged-411fbe6e-4a07-4237-8ab5-32bd2faada30 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:31:51.272930 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6d9a04ab-7d68-44dc-9e8d-7964d51316db req-38ef3eaf-cdf9-4f47-964f-029723f5a2d2 service nova] Acquiring lock "4b6317aa-80aa-4472-a224-12c1e111fd29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:31:51.273353 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6d9a04ab-7d68-44dc-9e8d-7964d51316db req-38ef3eaf-cdf9-4f47-964f-029723f5a2d2 service nova] Lock "4b6317aa-80aa-4472-a224-12c1e111fd29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:31:51.273650 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-6d9a04ab-7d68-44dc-9e8d-7964d51316db req-38ef3eaf-cdf9-4f47-964f-029723f5a2d2 service nova] Lock "4b6317aa-80aa-4472-a224-12c1e111fd29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:31:51.273994 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6d9a04ab-7d68-44dc-9e8d-7964d51316db req-38ef3eaf-cdf9-4f47-964f-029723f5a2d2 service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] No waiting events found dispatching network-vif-unplugged-411fbe6e-4a07-4237-8ab5-32bd2faada30 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:31:51.274565 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-6d9a04ab-7d68-44dc-9e8d-7964d51316db req-38ef3eaf-cdf9-4f47-964f-029723f5a2d2 service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Received event network-vif-unplugged-411fbe6e-4a07-4237-8ab5-32bd2faada30 for instance with task_state deleting. {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11641}} Jan 26 19:31:51.550495 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [-] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:31:51.636380 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-ddf8fea7-67b0-493e-9ca4-cfbd4698d7c3 req-eb756fb7-72b4-4b1d-ac03-f38b9a78b1db service nova] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Detach interface failed, port_id=411fbe6e-4a07-4237-8ab5-32bd2faada30, reason: Instance 4b6317aa-80aa-4472-a224-12c1e111fd29 could not be found. {{(pid=189076) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11697}} Jan 26 19:31:52.053567 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Took 1.70 seconds to deallocate network for instance. Jan 26 19:31:52.561228 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:31:52.561694 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:31:52.661222 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:31:53.165036 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:31:53.669797 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.108s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:31:53.708914 np0005596550.novalocal nova-compute[189076]: INFO nova.scheduler.client.report [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Deleted allocations for instance 4b6317aa-80aa-4472-a224-12c1e111fd29 Jan 26 19:31:54.717899 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-f3443f29-4ba0-449a-a35e-6462001ab712 tempest-VolumesExtendAttachedTest-486327567 tempest-VolumesExtendAttachedTest-486327567-project-member] Lock "4b6317aa-80aa-4472-a224-12c1e111fd29" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.169s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:31:54.836655 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:31:54.838024 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:31:54.838111 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:31:54.838191 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:31:54.877808 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:54.878093 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:31:55.891448 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:31:59.879970 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:31:59.951957 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:31:59.951957 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:31:59.951957 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:31:59.952805 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:31:59.953090 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:32:00.816357 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:02.812733 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:04.325928 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:32:04.326269 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [-] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] VM Stopped (Lifecycle Event) Jan 26 19:32:04.829651 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a2590000-0f4a-4dd1-9655-27e8902feb9e None None] [instance: 4b6317aa-80aa-4472-a224-12c1e111fd29] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:32:04.988578 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:09.990553 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:32:10.030797 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:32:10.031196 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5042 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:32:10.031456 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:32:10.033044 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:10.033519 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:32:15.067170 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:32:15.067170 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:32:15.067170 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=189076) run /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:117}} Jan 26 19:32:15.067170 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:32:15.067170 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:15.067941 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=189076) _transition /usr/local/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jan 26 19:32:20.068175 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:24.895366 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:25.069454 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:27.146046 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:28.663499 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:30.070587 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:30.773966 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Acquiring lock "05fc4f8b-7d3e-44fe-bc86-fe66d5d094de" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:32:30.774374 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Lock "05fc4f8b-7d3e-44fe-bc86-fe66d5d094de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:32:31.278333 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Starting instance... {{(pid=189076) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2499}} Jan 26 19:32:31.833158 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:32:31.833595 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:32:31.839054 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=189076) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2542}} Jan 26 19:32:31.839452 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.claims [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Claim successful on node np0005596550.novalocal Jan 26 19:32:31.895177 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:32:32.949837 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:32:33.453836 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:32:33.666455 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:33.960872 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.127s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:32:33.961356 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Start building networks asynchronously for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2897}} Jan 26 19:32:34.469157 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Allocating IP information in the background. {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2043}} Jan 26 19:32:34.469157 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:32:34.469458 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:32:34.469719 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:32:34.537468 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef445dc7773649328d2973e25e8f5176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0ff21c12df40e98d9a495c23ae7ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:32:34.972591 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jan 26 19:32:35.073184 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:35.154801 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Successfully created port: dc577438-b4a9-446b-8787-a70b8ab24faa {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:32:35.475726 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Start building block device mappings for instance. {{(pid=189076) _build_resources /opt/stack/nova/nova/compute/manager.py:2932}} Jan 26 19:32:35.509126 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Successfully updated port: dc577438-b4a9-446b-8787-a70b8ab24faa {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:32:35.529158 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-1fc32afd-082d-4505-9beb-9b49eb947151 req-09654b8d-0098-4d97-9b8b-7f4417f3ed8d service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Received event network-changed-dc577438-b4a9-446b-8787-a70b8ab24faa {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:32:35.529300 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-1fc32afd-082d-4505-9beb-9b49eb947151 req-09654b8d-0098-4d97-9b8b-7f4417f3ed8d service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Refreshing instance network info cache due to event network-changed-dc577438-b4a9-446b-8787-a70b8ab24faa. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:32:35.529465 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1fc32afd-082d-4505-9beb-9b49eb947151 req-09654b8d-0098-4d97-9b8b-7f4417f3ed8d service nova] Acquiring lock "refresh_cache-05fc4f8b-7d3e-44fe-bc86-fe66d5d094de" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:32:35.529584 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1fc32afd-082d-4505-9beb-9b49eb947151 req-09654b8d-0098-4d97-9b8b-7f4417f3ed8d service nova] Acquired lock "refresh_cache-05fc4f8b-7d3e-44fe-bc86-fe66d5d094de" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:32:35.529721 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-1fc32afd-082d-4505-9beb-9b49eb947151 req-09654b8d-0098-4d97-9b8b-7f4417f3ed8d service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Refreshing network info cache for port dc577438-b4a9-446b-8787-a70b8ab24faa {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:32:36.012240 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Acquiring lock "refresh_cache-05fc4f8b-7d3e-44fe-bc86-fe66d5d094de" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:32:36.033848 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-1fc32afd-082d-4505-9beb-9b49eb947151 req-09654b8d-0098-4d97-9b8b-7f4417f3ed8d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:32:36.088100 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-1fc32afd-082d-4505-9beb-9b49eb947151 req-09654b8d-0098-4d97-9b8b-7f4417f3ed8d service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:32:36.224812 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-1fc32afd-082d-4505-9beb-9b49eb947151 req-09654b8d-0098-4d97-9b8b-7f4417f3ed8d service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Updating instance_info_cache with network_info: [] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:32:36.487176 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Start spawning the instance on the hypervisor. {{(pid=189076) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2705}} Jan 26 19:32:36.488797 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Creating instance directory {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5161}} Jan 26 19:32:36.489305 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Creating image(s) Jan 26 19:32:36.490145 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Acquiring lock "/opt/stack/data/nova/instances/05fc4f8b-7d3e-44fe-bc86-fe66d5d094de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:32:36.490496 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Lock "/opt/stack/data/nova/instances/05fc4f8b-7d3e-44fe-bc86-fe66d5d094de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:32:36.491417 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Lock "/opt/stack/data/nova/instances/05fc4f8b-7d3e-44fe-bc86-fe66d5d094de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:32:36.492412 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:32:36.498248 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:32:36.499794 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:32:36.568736 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.068s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:32:36.569383 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Acquiring lock "d4ec553964c5911a26092d7cf449261357c7d4aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:32:36.570191 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:32:36.570876 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:32:36.576633 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_utils.imageutils.format_inspector [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=189076) _process_chunk /usr/local/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1537}} Jan 26 19:32:36.577230 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:32:36.639009 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.061s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:32:36.639715 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/05fc4f8b-7d3e-44fe-bc86-fe66d5d094de/disk 1073741824 {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:32:36.728953 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-1fc32afd-082d-4505-9beb-9b49eb947151 req-09654b8d-0098-4d97-9b8b-7f4417f3ed8d service nova] Releasing lock "refresh_cache-05fc4f8b-7d3e-44fe-bc86-fe66d5d094de" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:32:36.729915 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Acquired lock "refresh_cache-05fc4f8b-7d3e-44fe-bc86-fe66d5d094de" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:32:36.730335 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:32:37.210306 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa,backing_fmt=raw /opt/stack/data/nova/instances/05fc4f8b-7d3e-44fe-bc86-fe66d5d094de/disk 1073741824" returned: 0 in 0.570s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:32:37.210976 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Lock "d4ec553964c5911a26092d7cf449261357c7d4aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.641s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:32:37.211459 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:32:37.300124 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Instance cache missing network info. {{(pid=189076) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}} Jan 26 19:32:37.348865 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ec553964c5911a26092d7cf449261357c7d4aa --force-share --output=json" returned: 0 in 0.137s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:32:37.349108 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05fc4f8b-7d3e-44fe-bc86-fe66d5d094de/disk. size=1073741824 {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:164}} Jan 26 19:32:37.349361 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05fc4f8b-7d3e-44fe-bc86-fe66d5d094de/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:32:37.424373 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05fc4f8b-7d3e-44fe-bc86-fe66d5d094de/disk --force-share --output=json" returned: 0 in 0.074s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:32:37.424625 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.disk.api [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Cannot resize image /opt/stack/data/nova/instances/05fc4f8b-7d3e-44fe-bc86-fe66d5d094de/disk to a smaller size. {{(pid=189076) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:170}} Jan 26 19:32:37.424983 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Created local disks {{(pid=189076) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5293}} Jan 26 19:32:37.425156 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Ensure instance console log exists: /opt/stack/data/nova/instances/05fc4f8b-7d3e-44fe-bc86-fe66d5d094de/console.log {{(pid=189076) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5040}} Jan 26 19:32:37.425459 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:32:37.425660 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:32:37.425841 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:32:37.444737 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:32:37.546555 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Updating instance_info_cache with network_info: [{"id": "dc577438-b4a9-446b-8787-a70b8ab24faa", "address": "fa:16:3e:f1:4c:15", "network": {"id": "ea432c68-e894-4375-b92e-812396ec9e92", "bridge": "br-int", "label": "tempest-network-smoke--369171892", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0ff21c12df40e98d9a495c23ae7ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc577438-b4", "ovs_interfaceid": "dc577438-b4a9-446b-8787-a70b8ab24faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:32:38.050288 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Releasing lock "refresh_cache-05fc4f8b-7d3e-44fe-bc86-fe66d5d094de" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:32:38.050935 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Instance network_info: |[{"id": "dc577438-b4a9-446b-8787-a70b8ab24faa", "address": "fa:16:3e:f1:4c:15", "network": {"id": "ea432c68-e894-4375-b92e-812396ec9e92", "bridge": "br-int", "label": "tempest-network-smoke--369171892", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0ff21c12df40e98d9a495c23ae7ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc577438-b4", "ovs_interfaceid": "dc577438-b4a9-446b-8787-a70b8ab24faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=189076) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2058}} Jan 26 19:32:38.055151 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Start _get_guest_xml network_info=[{"id": "dc577438-b4a9-446b-8787-a70b8ab24faa", "address": "fa:16:3e:f1:4c:15", "network": {"id": "ea432c68-e894-4375-b92e-812396ec9e92", "bridge": "br-int", "label": "tempest-network-smoke--369171892", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0ff21c12df40e98d9a495c23ae7ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc577438-b4", "ovs_interfaceid": "dc577438-b4a9-446b-8787-a70b8ab24faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '83e5abfe-72a8-4364-96d1-e39a77cf888f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8079}} Jan 26 19:32:38.059967 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:32:38.061984 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-TestNetworkBasicOps-server-1971333028', uuid='05fc4f8b-7d3e-44fe-bc86-fe66d5d094de'), owner=OwnerMeta(userid='ef445dc7773649328d2973e25e8f5176', username='tempest-TestNetworkBasicOps-60627388-project-member', projectid='2a0ff21c12df40e98d9a495c23ae7ec5', projectname='tempest-TestNetworkBasicOps-60627388'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dc577438-b4a9-446b-8787-a70b8ab24faa", "address": "fa:16:3e:f1:4c:15", "network": {"id": "ea432c68-e894-4375-b92e-812396ec9e92", "bridge": "br-int", "label": "tempest-network-smoke--369171892", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0ff21c12df40e98d9a495c23ae7ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc577438-b4", "ovs_interfaceid": "dc577438-b4a9-446b-8787-a70b8ab24faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769473958.061342) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:32:38.063702 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V1... {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1703}} Jan 26 19:32:38.064395 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] CPU controller missing on host. {{(pid=189076) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1713}} Jan 26 19:32:38.065820 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Searching host: 'np0005596550.novalocal' for CPU controller through CGroups V2... {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1722}} Jan 26 19:32:38.066508 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.host [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] CPU controller found on host. {{(pid=189076) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1729}} Jan 26 19:32:38.068222 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=189076) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5832}} Jan 26 19:32:38.069031 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-01-26T23:50:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-01-26T23:49:32Z,direct_url=,disk_format='qcow2',id=83e5abfe-72a8-4364-96d1-e39a77cf888f,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='51b7780042c64addb52fb6fe9587a219',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-01-26T23:49:35Z,virtual_size=,visibility=), allow threads: True {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:571}} Jan 26 19:32:38.069439 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Flavor limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:356}} Jan 26 19:32:38.069727 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Image limits 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:360}} Jan 26 19:32:38.070103 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Flavor pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:396}} Jan 26 19:32:38.070419 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Image pref 0:0:0 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:400}} Jan 26 19:32:38.070715 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=189076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:438}} Jan 26 19:32:38.071145 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}} Jan 26 19:32:38.071442 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:479}} Jan 26 19:32:38.071750 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Got 1 possible topologies {{(pid=189076) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:509}} Jan 26 19:32:38.072211 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:583}} Jan 26 19:32:38.072654 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.hardware [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=189076) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:585}} Jan 26 19:32:38.078322 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:32:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestNetworkBasicOps-server-1971333028',display_name='tempest-TestNetworkBasicOps-server-1971333028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-testnetworkbasicops-server-1971333028',id=108,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcxcI3lxhqYhuxbxFviwycODXCjIfv3oGGOkQjmVSTcM8dPj1nmDqiNwu+rIQVu4VESMM8YqqXIK76WjfudGPa4Jg8u7B3APCs4jTzSOlAdS9NNbsJkAms74ABTx+SRkQ==',key_name='tempest-TestNetworkBasicOps-708274738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a0ff21c12df40e98d9a495c23ae7ec5',ramdisk_id='',reservation_id='r-mrali2y6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestNetworkBasicOps-60627388',owner_user_name='tempest-TestNetworkBasicOps-60627388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:32:35Z,user_data=None,user_id='ef445dc7773649328d2973e25e8f5176',uuid=05fc4f8b-7d3e-44fe-bc86-fe66d5d094de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc577438-b4a9-446b-8787-a70b8ab24faa", "address": "fa:16:3e:f1:4c:15", "network": {"id": "ea432c68-e894-4375-b92e-812396ec9e92", "bridge": "br-int", "label": "tempest-network-smoke--369171892", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0ff21c12df40e98d9a495c23ae7ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc577438-b4", "ovs_interfaceid": "dc577438-b4a9-446b-8787-a70b8ab24faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:32:38.078900 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Converting VIF {"id": "dc577438-b4a9-446b-8787-a70b8ab24faa", "address": "fa:16:3e:f1:4c:15", "network": {"id": "ea432c68-e894-4375-b92e-812396ec9e92", "bridge": "br-int", "label": "tempest-network-smoke--369171892", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0ff21c12df40e98d9a495c23ae7ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc577438-b4", "ovs_interfaceid": "dc577438-b4a9-446b-8787-a70b8ab24faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:32:38.079986 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:4c:15,bridge_name='br-int',has_traffic_filtering=True,id=dc577438-b4a9-446b-8787-a70b8ab24faa,network=Network(ea432c68-e894-4375-b92e-812396ec9e92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc577438-b4') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:32:38.081049 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Lazy-loading 'pci_devices' on Instance uuid 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] End _get_guest_xml xml= Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: instance-0000006c Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: tempest-TestNetworkBasicOps-server-1971333028 Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:32:38 Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: tempest-TestNetworkBasicOps-60627388-project-member Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: tempest-TestNetworkBasicOps-60627388 Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: 128 Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: /dev/urandom Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: Jan 26 19:32:38.587598 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8085}} Jan 26 19:32:38.591426 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Preparing to wait for external event network-vif-plugged-dc577438-b4a9-446b-8787-a70b8ab24faa {{(pid=189076) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jan 26 19:32:38.591426 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Acquiring lock "05fc4f8b-7d3e-44fe-bc86-fe66d5d094de-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:32:38.591426 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Lock "05fc4f8b-7d3e-44fe-bc86-fe66d5d094de-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:32:38.591426 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Lock "05fc4f8b-7d3e-44fe-bc86-fe66d5d094de-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:32:38.591426 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-01-27T00:32:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestNetworkBasicOps-server-1971333028',display_name='tempest-TestNetworkBasicOps-server-1971333028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-testnetworkbasicops-server-1971333028',id=108,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcxcI3lxhqYhuxbxFviwycODXCjIfv3oGGOkQjmVSTcM8dPj1nmDqiNwu+rIQVu4VESMM8YqqXIK76WjfudGPa4Jg8u7B3APCs4jTzSOlAdS9NNbsJkAms74ABTx+SRkQ==',key_name='tempest-TestNetworkBasicOps-708274738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0005596550.novalocal',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a0ff21c12df40e98d9a495c23ae7ec5',ramdisk_id='',reservation_id='r-mrali2y6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestNetworkBasicOps-60627388',owner_user_name='tempest-TestNetworkBasicOps-60627388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-01-27T00:32:35Z,user_data=None,user_id='ef445dc7773649328d2973e25e8f5176',uuid=05fc4f8b-7d3e-44fe-bc86-fe66d5d094de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc577438-b4a9-446b-8787-a70b8ab24faa", "address": "fa:16:3e:f1:4c:15", "network": {"id": "ea432c68-e894-4375-b92e-812396ec9e92", "bridge": "br-int", "label": "tempest-network-smoke--369171892", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0ff21c12df40e98d9a495c23ae7ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc577438-b4", "ovs_interfaceid": "dc577438-b4a9-446b-8787-a70b8ab24faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:32:38.591825 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Converting VIF {"id": "dc577438-b4a9-446b-8787-a70b8ab24faa", "address": "fa:16:3e:f1:4c:15", "network": {"id": "ea432c68-e894-4375-b92e-812396ec9e92", "bridge": "br-int", "label": "tempest-network-smoke--369171892", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0ff21c12df40e98d9a495c23ae7ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc577438-b4", "ovs_interfaceid": "dc577438-b4a9-446b-8787-a70b8ab24faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:32:38.594806 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:4c:15,bridge_name='br-int',has_traffic_filtering=True,id=dc577438-b4a9-446b-8787-a70b8ab24faa,network=Network(ea432c68-e894-4375-b92e-812396ec9e92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc577438-b4') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:32:38.595094 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:4c:15,bridge_name='br-int',has_traffic_filtering=True,id=dc577438-b4a9-446b-8787-a70b8ab24faa,network=Network(ea432c68-e894-4375-b92e-812396ec9e92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc577438-b4') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:32:38.596061 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:38.596844 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:32:38.597534 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:32:38.598840 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:38.599416 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da040c0b-a187-5150-b137-aa41585c980e', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:32:38.601007 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:38.604221 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:32:38.605015 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:38.609734 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:38.609893 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc577438-b4, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:32:38.610563 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc577438-b4, col_values=(('qos', UUID('3ec6ca50-76c7-4388-b52b-8517c719d89c')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:32:38.611000 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc577438-b4, col_values=(('external_ids', {'iface-id': 'dc577438-b4a9-446b-8787-a70b8ab24faa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:4c:15', 'vm-uuid': '05fc4f8b-7d3e-44fe-bc86-fe66d5d094de'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:32:38.612880 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:38.616833 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:32:38.623708 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:38.625335 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:4c:15,bridge_name='br-int',has_traffic_filtering=True,id=dc577438-b4a9-446b-8787-a70b8ab24faa,network=Network(ea432c68-e894-4375-b92e-812396ec9e92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc577438-b4') Jan 26 19:32:39.895641 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:32:39.896056 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:32:40.152467 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:32:40.152580 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:32:40.152792 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] No VIF found with MAC fa:16:3e:f1:4c:15, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:32:40.153326 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Using config drive Jan 26 19:32:40.401340 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:32:40.401615 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:32:40.401836 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:32:40.402032 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Auditing locally available compute resources for np0005596550.novalocal (node: np0005596550.novalocal) {{(pid=189076) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jan 26 19:32:40.659106 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:32:40.727704 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Creating config drive at /opt/stack/data/nova/instances/05fc4f8b-7d3e-44fe-bc86-fe66d5d094de/disk.config Jan 26 19:32:40.732368 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Running cmd (subprocess): /usr/bin/mkisofs -o /opt/stack/data/nova/instances/05fc4f8b-7d3e-44fe-bc86-fe66d5d094de/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpoyq5niyj {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:32:40.851421 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] CMD "/usr/bin/mkisofs -o /opt/stack/data/nova/instances/05fc4f8b-7d3e-44fe-bc86-fe66d5d094de/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 32.1.0 -quiet -J -r -V config-2 /tmp/tmpoyq5niyj" returned: 0 in 0.119s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:32:40.914935 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:40.922709 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:41.106038 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-38f81148-6d54-4449-b563-be99245bea9e req-b59cd973-01de-4eaa-b727-dcc658f2b08c service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Received event network-vif-plugged-dc577438-b4a9-446b-8787-a70b8ab24faa {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:32:41.106346 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-38f81148-6d54-4449-b563-be99245bea9e req-b59cd973-01de-4eaa-b727-dcc658f2b08c service nova] Acquiring lock "05fc4f8b-7d3e-44fe-bc86-fe66d5d094de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:32:41.107133 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-38f81148-6d54-4449-b563-be99245bea9e req-b59cd973-01de-4eaa-b727-dcc658f2b08c service nova] Lock "05fc4f8b-7d3e-44fe-bc86-fe66d5d094de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:32:41.107133 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-38f81148-6d54-4449-b563-be99245bea9e req-b59cd973-01de-4eaa-b727-dcc658f2b08c service nova] Lock "05fc4f8b-7d3e-44fe-bc86-fe66d5d094de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:32:41.107133 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-38f81148-6d54-4449-b563-be99245bea9e req-b59cd973-01de-4eaa-b727-dcc658f2b08c service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Processing event network-vif-plugged-dc577438-b4a9-446b-8787-a70b8ab24faa {{(pid=189076) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11623}} Jan 26 19:32:41.139829 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Started> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:32:41.139829 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] VM Started (Lifecycle Event) Jan 26 19:32:41.139829 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=189076) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jan 26 19:32:41.143681 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Guest created on hypervisor {{(pid=189076) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4839}} Jan 26 19:32:41.151101 np0005596550.novalocal nova-compute[189076]: INFO nova.virt.libvirt.driver [-] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Instance spawned successfully. Jan 26 19:32:41.151101 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:999}} Jan 26 19:32:41.211787 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:41.215639 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:41.217916 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:41.220057 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:41.428166 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05fc4f8b-7d3e-44fe-bc86-fe66d5d094de/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:32:41.503503 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05fc4f8b-7d3e-44fe-bc86-fe66d5d094de/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:32:41.503913 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): /usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05fc4f8b-7d3e-44fe-bc86-fe66d5d094de/disk --force-share --output=json {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:32:41.601783 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "/usr/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05fc4f8b-7d3e-44fe-bc86-fe66d5d094de/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:32:41.642105 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:32:41.645057 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:32:41.659061 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Found default for hw_cdrom_bus of ide {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:32:41.659061 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Found default for hw_disk_bus of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:32:41.659347 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Found default for hw_input_bus of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:32:41.659595 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Found default for hw_pointer_model of None {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:32:41.659967 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Found default for hw_video_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:32:41.660287 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Found default for hw_vif_model of virtio {{(pid=189076) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1028}} Jan 26 19:32:41.725113 np0005596550.novalocal nova-compute[189076]: WARNING nova.virt.libvirt.driver [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jan 26 19:32:41.725917 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:32:41.739618 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.processutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CMD "env LANG=C uptime" returned: 0 in 0.013s {{(pid=189076) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:32:41.740468 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Hypervisor/Node resource view: name=np0005596550.novalocal free_ram=7599MB free_disk=371.71240997314453GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7000", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_3", "address": "0000:00:01.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "1001", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1001", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_1", "address": "0000:00:01.1", "product_id": "7010", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7010", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "1005", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1005", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "1237", "vendor_id": "8086", "numa_node": null, "label": "label_8086_1237", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "1000", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1000", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_05_0", "address": "0000:00:05.0", "product_id": "1002", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1002", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_2", "address": "0000:00:01.2", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}] {{(pid=189076) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jan 26 19:32:41.740468 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:32:41.740468 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:32:42.148396 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] During sync_power_state the instance has a pending task (spawning). Skip. Jan 26 19:32:42.148967 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Paused> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:32:42.148967 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] VM Paused (Lifecycle Event) Jan 26 19:32:42.165992 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Took 5.68 seconds to spawn the instance on the hypervisor. Jan 26 19:32:42.166231 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:32:42.652197 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:32:42.654902 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] Emitting event Resumed> {{(pid=189076) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jan 26 19:32:42.655117 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] VM Resumed (Lifecycle Event) Jan 26 19:32:42.678475 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Took 10.89 seconds to build instance. Jan 26 19:32:42.793288 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Instance 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=189076) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jan 26 19:32:42.793729 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Total usable vcpus: 8, total allocated vcpus: 1 {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jan 26 19:32:42.794147 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Final resource view: name=np0005596550.novalocal phys_ram=15729MB used_ram=704MB phys_disk=399GB used_disk=1GB total_vcpus=8 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 19:32:41 up 1:00, 13 users, load average: 1.44, 1.68, 2.73\n', 'num_instances': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_os_type_None': '1', 'num_proj_2a0ff21c12df40e98d9a495c23ae7ec5': '1', 'io_workload': '1'} {{(pid=189076) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jan 26 19:32:42.890971 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.provider_tree [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed in ProviderTree for provider: f627156c-932e-4a32-97b3-315a994a2ac9 {{(pid=189076) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jan 26 19:32:43.158538 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Checking state {{(pid=189076) _get_power_state /opt/stack/nova/nova/compute/manager.py:1852}} Jan 26 19:32:43.163340 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-79a112e7-dbe9-4b79-8d5a-6cc6d06fd3cd None None] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=189076) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1464}} Jan 26 19:32:43.180616 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-a5b640e9-d2c2-4a83-bb46-d7c880674078 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Lock "05fc4f8b-7d3e-44fe-bc86-fe66d5d094de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 12.406s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:32:43.198514 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-13a97ce0-63a5-4a2b-97ae-59ced02b263c req-daf99512-fb38-47b2-8672-0e1a8951e97c service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Received event network-vif-plugged-dc577438-b4a9-446b-8787-a70b8ab24faa {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:32:43.198514 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-13a97ce0-63a5-4a2b-97ae-59ced02b263c req-daf99512-fb38-47b2-8672-0e1a8951e97c service nova] Acquiring lock "05fc4f8b-7d3e-44fe-bc86-fe66d5d094de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:32:43.198871 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-13a97ce0-63a5-4a2b-97ae-59ced02b263c req-daf99512-fb38-47b2-8672-0e1a8951e97c service nova] Lock "05fc4f8b-7d3e-44fe-bc86-fe66d5d094de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:32:43.198871 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-13a97ce0-63a5-4a2b-97ae-59ced02b263c req-daf99512-fb38-47b2-8672-0e1a8951e97c service nova] Lock "05fc4f8b-7d3e-44fe-bc86-fe66d5d094de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:32:43.199237 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-13a97ce0-63a5-4a2b-97ae-59ced02b263c req-daf99512-fb38-47b2-8672-0e1a8951e97c service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] No waiting events found dispatching network-vif-plugged-dc577438-b4a9-446b-8787-a70b8ab24faa {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:32:43.199458 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-13a97ce0-63a5-4a2b-97ae-59ced02b263c req-daf99512-fb38-47b2-8672-0e1a8951e97c service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Received unexpected event network-vif-plugged-dc577438-b4a9-446b-8787-a70b8ab24faa for instance with vm_state active and task_state None. Jan 26 19:32:43.394948 np0005596550.novalocal nova-compute[189076]: DEBUG nova.scheduler.client.report [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Inventory has not changed for provider f627156c-932e-4a32-97b3-315a994a2ac9 based on inventory data: {'VCPU': {'total': 8, 'reserved': 0, 'min_unit': 1, 'max_unit': 8, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 15729, 'reserved': 512, 'min_unit': 1, 'max_unit': 15729, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 399, 'reserved': 0, 'min_unit': 1, 'max_unit': 399, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=189076) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jan 26 19:32:43.613810 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:43.669136 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:43.901601 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.resource_tracker [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Compute_service record updated for np0005596550.novalocal:np0005596550.novalocal {{(pid=189076) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jan 26 19:32:43.901963 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.162s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:32:45.241044 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-07cc7c48-ac06-43a4-b872-1902f2392b7e req-c8b33d54-d75d-46f0-96ac-f00719e45ac9 service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Received event network-changed-dc577438-b4a9-446b-8787-a70b8ab24faa {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:32:45.241489 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-07cc7c48-ac06-43a4-b872-1902f2392b7e req-c8b33d54-d75d-46f0-96ac-f00719e45ac9 service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Refreshing instance network info cache due to event network-changed-dc577438-b4a9-446b-8787-a70b8ab24faa. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:32:45.241657 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-07cc7c48-ac06-43a4-b872-1902f2392b7e req-c8b33d54-d75d-46f0-96ac-f00719e45ac9 service nova] Acquiring lock "refresh_cache-05fc4f8b-7d3e-44fe-bc86-fe66d5d094de" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:32:45.241934 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-07cc7c48-ac06-43a4-b872-1902f2392b7e req-c8b33d54-d75d-46f0-96ac-f00719e45ac9 service nova] Acquired lock "refresh_cache-05fc4f8b-7d3e-44fe-bc86-fe66d5d094de" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:32:45.242233 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-07cc7c48-ac06-43a4-b872-1902f2392b7e req-c8b33d54-d75d-46f0-96ac-f00719e45ac9 service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Refreshing network info cache for port dc577438-b4a9-446b-8787-a70b8ab24faa {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:32:45.748253 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-07cc7c48-ac06-43a4-b872-1902f2392b7e req-c8b33d54-d75d-46f0-96ac-f00719e45ac9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:32:45.903364 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:32:45.913171 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:32:45.913317 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:32:45.913440 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=189076) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11279}} Jan 26 19:32:45.968688 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-07cc7c48-ac06-43a4-b872-1902f2392b7e req-c8b33d54-d75d-46f0-96ac-f00719e45ac9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:32:46.051361 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-07cc7c48-ac06-43a4-b872-1902f2392b7e req-c8b33d54-d75d-46f0-96ac-f00719e45ac9 service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Updated VIF entry in instance network info cache for port dc577438-b4a9-446b-8787-a70b8ab24faa. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}} Jan 26 19:32:46.051608 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-07cc7c48-ac06-43a4-b872-1902f2392b7e req-c8b33d54-d75d-46f0-96ac-f00719e45ac9 service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Updating instance_info_cache with network_info: [{"id": "dc577438-b4a9-446b-8787-a70b8ab24faa", "address": "fa:16:3e:f1:4c:15", "network": {"id": "ea432c68-e894-4375-b92e-812396ec9e92", "bridge": "br-int", "label": "tempest-network-smoke--369171892", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0ff21c12df40e98d9a495c23ae7ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc577438-b4", "ovs_interfaceid": "dc577438-b4a9-446b-8787-a70b8ab24faa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:32:46.555080 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-07cc7c48-ac06-43a4-b872-1902f2392b7e req-c8b33d54-d75d-46f0-96ac-f00719e45ac9 service nova] Releasing lock "refresh_cache-05fc4f8b-7d3e-44fe-bc86-fe66d5d094de" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:32:46.896320 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:32:48.616214 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:48.670395 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:49.891458 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_service.periodic_task [None req-ff3d9b7b-3c0a-4f61-989d-a5d4408b8952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=189076) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:32:53.618291 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:53.672404 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:58.619254 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:32:58.673586 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:03.620734 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:03.676368 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:06.757941 np0005596550.novalocal nova-compute[189076]: INFO nova.compute.manager [None req-4a36ff3c-80b9-4751-9fe8-5b14bd88a90a tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Get console output Jan 26 19:33:06.764423 np0005596550.novalocal nova-compute[189076]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes Jan 26 19:33:07.740728 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:08.622677 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:08.678410 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:09.923696 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Acquiring lock "interface-05fc4f8b-7d3e-44fe-bc86-fe66d5d094de-None" by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:33:09.924318 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Lock "interface-05fc4f8b-7d3e-44fe-bc86-fe66d5d094de-None" acquired by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:33:09.924764 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Lazy-loading 'flavor' on Instance uuid 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:33:10.429262 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:33:10.586209 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Lazy-loading 'pci_requests' on Instance uuid 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:33:11.089933 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.base [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Object Instance<05fc4f8b-7d3e-44fe-bc86-fe66d5d094de> lazy-loaded attributes: flavor,pci_requests {{(pid=189076) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jan 26 19:33:11.090476 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] allocate_for_instance() {{(pid=189076) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}} Jan 26 19:33:11.090964 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:33:11.091432 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:33:11.156789 np0005596550.novalocal nova-compute[189076]: DEBUG nova.policy [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef445dc7773649328d2973e25e8f5176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0ff21c12df40e98d9a495c23ae7ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=189076) authorize /opt/stack/nova/nova/policy.py:192}} Jan 26 19:33:11.568793 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Successfully created port: 9233f5ce-61fb-446a-aa53-caefe8de23b9 {{(pid=189076) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}} Jan 26 19:33:11.979873 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Successfully updated port: 9233f5ce-61fb-446a-aa53-caefe8de23b9 {{(pid=189076) _update_port /opt/stack/nova/nova/network/neutron.py:567}} Jan 26 19:33:12.006144 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-839ca4eb-2b63-4183-9ead-c97637cc1db1 req-5a50aa93-5d1f-432b-a89a-bd75d242fb19 service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Received event network-changed-9233f5ce-61fb-446a-aa53-caefe8de23b9 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:33:12.006324 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-839ca4eb-2b63-4183-9ead-c97637cc1db1 req-5a50aa93-5d1f-432b-a89a-bd75d242fb19 service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Refreshing instance network info cache due to event network-changed-9233f5ce-61fb-446a-aa53-caefe8de23b9. {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11868}} Jan 26 19:33:12.006517 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-839ca4eb-2b63-4183-9ead-c97637cc1db1 req-5a50aa93-5d1f-432b-a89a-bd75d242fb19 service nova] Acquiring lock "refresh_cache-05fc4f8b-7d3e-44fe-bc86-fe66d5d094de" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:33:12.006665 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-839ca4eb-2b63-4183-9ead-c97637cc1db1 req-5a50aa93-5d1f-432b-a89a-bd75d242fb19 service nova] Acquired lock "refresh_cache-05fc4f8b-7d3e-44fe-bc86-fe66d5d094de" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:33:12.007755 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-839ca4eb-2b63-4183-9ead-c97637cc1db1 req-5a50aa93-5d1f-432b-a89a-bd75d242fb19 service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Refreshing network info cache for port 9233f5ce-61fb-446a-aa53-caefe8de23b9 {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jan 26 19:33:12.482934 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Acquiring lock "refresh_cache-05fc4f8b-7d3e-44fe-bc86-fe66d5d094de" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:313}} Jan 26 19:33:12.509597 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-839ca4eb-2b63-4183-9ead-c97637cc1db1 req-5a50aa93-5d1f-432b-a89a-bd75d242fb19 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:33:12.718952 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [req-839ca4eb-2b63-4183-9ead-c97637cc1db1 req-5a50aa93-5d1f-432b-a89a-bd75d242fb19 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:33:12.809790 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-839ca4eb-2b63-4183-9ead-c97637cc1db1 req-5a50aa93-5d1f-432b-a89a-bd75d242fb19 service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Added VIF to instance network info cache for port 9233f5ce-61fb-446a-aa53-caefe8de23b9. {{(pid=189076) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3528}} Jan 26 19:33:12.810071 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [req-839ca4eb-2b63-4183-9ead-c97637cc1db1 req-5a50aa93-5d1f-432b-a89a-bd75d242fb19 service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Updating instance_info_cache with network_info: [{"id": "dc577438-b4a9-446b-8787-a70b8ab24faa", "address": "fa:16:3e:f1:4c:15", "network": {"id": "ea432c68-e894-4375-b92e-812396ec9e92", "bridge": "br-int", "label": "tempest-network-smoke--369171892", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0ff21c12df40e98d9a495c23ae7ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc577438-b4", "ovs_interfaceid": "dc577438-b4a9-446b-8787-a70b8ab24faa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9233f5ce-61fb-446a-aa53-caefe8de23b9", "address": "fa:16:3e:3e:b3:51", "network": {"id": "5e284e07-fd95-4c86-9fe9-f107f2c15155", "bridge": "br-int", "label": "tempest-network-smoke--750310507", "subnets": [{"cidr": "10.1.0.16/28", "dns": [], "gateway": {"address": null, "type": "gateway", "version": null, "meta": {}}, "ips": [{"address": "10.1.0.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0ff21c12df40e98d9a495c23ae7ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9233f5ce-61", "ovs_interfaceid": "9233f5ce-61fb-446a-aa53-caefe8de23b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:33:13.313146 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-839ca4eb-2b63-4183-9ead-c97637cc1db1 req-5a50aa93-5d1f-432b-a89a-bd75d242fb19 service nova] Releasing lock "refresh_cache-05fc4f8b-7d3e-44fe-bc86-fe66d5d094de" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:33:13.313730 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Acquired lock "refresh_cache-05fc4f8b-7d3e-44fe-bc86-fe66d5d094de" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:316}} Jan 26 19:33:13.314228 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Building network info cache for instance {{(pid=189076) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jan 26 19:33:13.624642 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:13.679949 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:13.861106 np0005596550.novalocal nova-compute[189076]: WARNING nova.network.neutron [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] 5e284e07-fd95-4c86-9fe9-f107f2c15155 already exists in list: networks containing: ['5e284e07-fd95-4c86-9fe9-f107f2c15155']. ignoring it Jan 26 19:33:13.861250 np0005596550.novalocal nova-compute[189076]: WARNING nova.network.neutron [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] 9233f5ce-61fb-446a-aa53-caefe8de23b9 already exists in list: port_ids containing: ['9233f5ce-61fb-446a-aa53-caefe8de23b9']. ignoring it Jan 26 19:33:14.005783 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:33:14.191756 np0005596550.novalocal nova-compute[189076]: WARNING neutronclient.v2_0.client [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jan 26 19:33:14.269900 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.neutron [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Updating instance_info_cache with network_info: [{"id": "dc577438-b4a9-446b-8787-a70b8ab24faa", "address": "fa:16:3e:f1:4c:15", "network": {"id": "ea432c68-e894-4375-b92e-812396ec9e92", "bridge": "br-int", "label": "tempest-network-smoke--369171892", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0ff21c12df40e98d9a495c23ae7ec5", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc577438-b4", "ovs_interfaceid": "dc577438-b4a9-446b-8787-a70b8ab24faa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9233f5ce-61fb-446a-aa53-caefe8de23b9", "address": "fa:16:3e:3e:b3:51", "network": {"id": "5e284e07-fd95-4c86-9fe9-f107f2c15155", "bridge": "br-int", "label": "tempest-network-smoke--750310507", "subnets": [{"cidr": "10.1.0.16/28", "dns": [], "gateway": {"address": null, "type": "gateway", "version": null, "meta": {}}, "ips": [{"address": "10.1.0.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0ff21c12df40e98d9a495c23ae7ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9233f5ce-61", "ovs_interfaceid": "9233f5ce-61fb-446a-aa53-caefe8de23b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=189076) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}} Jan 26 19:33:14.772609 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Releasing lock "refresh_cache-05fc4f8b-7d3e-44fe-bc86-fe66d5d094de" {{(pid=189076) lock /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:334}} Jan 26 19:33:14.776222 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:32:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-TestNetworkBasicOps-server-1971333028',display_name='tempest-TestNetworkBasicOps-server-1971333028',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-testnetworkbasicops-server-1971333028',id=108,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcxcI3lxhqYhuxbxFviwycODXCjIfv3oGGOkQjmVSTcM8dPj1nmDqiNwu+rIQVu4VESMM8YqqXIK76WjfudGPa4Jg8u7B3APCs4jTzSOlAdS9NNbsJkAms74ABTx+SRkQ==',key_name='tempest-TestNetworkBasicOps-708274738',keypairs=,launch_index=0,launched_at=2026-01-27T00:32:42Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2a0ff21c12df40e98d9a495c23ae7ec5',ramdisk_id='',reservation_id='r-mrali2y6',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestNetworkBasicOps-60627388',owner_user_name='tempest-TestNetworkBasicOps-60627388-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:32:42Z,user_data=None,user_id='ef445dc7773649328d2973e25e8f5176',uuid=05fc4f8b-7d3e-44fe-bc86-fe66d5d094de,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9233f5ce-61fb-446a-aa53-caefe8de23b9", "address": "fa:16:3e:3e:b3:51", "network": {"id": "5e284e07-fd95-4c86-9fe9-f107f2c15155", "bridge": "br-int", "label": "tempest-network-smoke--750310507", "subnets": [{"cidr": "10.1.0.16/28", "dns": [], "gateway": {"address": null, "type": "gateway", "version": null, "meta": {}}, "ips": [{"address": "10.1.0.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0ff21c12df40e98d9a495c23ae7ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9233f5ce-61", "ovs_interfaceid": "9233f5ce-61fb-446a-aa53-caefe8de23b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) plug /opt/stack/nova/nova/virt/libvirt/vif.py:721}} Jan 26 19:33:14.776562 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Converting VIF {"id": "9233f5ce-61fb-446a-aa53-caefe8de23b9", "address": "fa:16:3e:3e:b3:51", "network": {"id": "5e284e07-fd95-4c86-9fe9-f107f2c15155", "bridge": "br-int", "label": "tempest-network-smoke--750310507", "subnets": [{"cidr": "10.1.0.16/28", "dns": [], "gateway": {"address": null, "type": "gateway", "version": null, "meta": {}}, "ips": [{"address": "10.1.0.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0ff21c12df40e98d9a495c23ae7ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9233f5ce-61", "ovs_interfaceid": "9233f5ce-61fb-446a-aa53-caefe8de23b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:33:14.777584 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:b3:51,bridge_name='br-int',has_traffic_filtering=True,id=9233f5ce-61fb-446a-aa53-caefe8de23b9,network=Network(5e284e07-fd95-4c86-9fe9-f107f2c15155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9233f5ce-61') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:33:14.778081 np0005596550.novalocal nova-compute[189076]: DEBUG os_vif [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:b3:51,bridge_name='br-int',has_traffic_filtering=True,id=9233f5ce-61fb-446a-aa53-caefe8de23b9,network=Network(5e284e07-fd95-4c86-9fe9-f107f2c15155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9233f5ce-61') {{(pid=189076) plug /usr/local/lib/python3.12/site-packages/os_vif/__init__.py:76}} Jan 26 19:33:14.778644 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:14.779125 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:33:14.779548 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jan 26 19:33:14.780583 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:14.781046 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f2d924c-728e-5012-ae4c-cfba1ec189de', '_type': 'linux-noop'}}, row=False) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:33:14.830666 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:14.833228 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:14.836797 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:14.837314 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9233f5ce-61, may_exist=True, interface_attrs={}) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:33:14.838010 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9233f5ce-61, col_values=(('qos', UUID('81d5e233-f481-4941-9a7f-8097a120d843')),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:33:14.838475 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9233f5ce-61, col_values=(('external_ids', {'iface-id': '9233f5ce-61fb-446a-aa53-caefe8de23b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:b3:51', 'vm-uuid': '05fc4f8b-7d3e-44fe-bc86-fe66d5d094de'}),), if_exists=True) {{(pid=189076) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jan 26 19:33:14.840210 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:14.844176 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:248}} Jan 26 19:33:14.852445 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:14.853987 np0005596550.novalocal nova-compute[189076]: INFO os_vif [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:b3:51,bridge_name='br-int',has_traffic_filtering=True,id=9233f5ce-61fb-446a-aa53-caefe8de23b9,network=Network(5e284e07-fd95-4c86-9fe9-f107f2c15155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9233f5ce-61') Jan 26 19:33:14.855269 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:32:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-TestNetworkBasicOps-server-1971333028',display_name='tempest-TestNetworkBasicOps-server-1971333028',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-testnetworkbasicops-server-1971333028',id=108,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcxcI3lxhqYhuxbxFviwycODXCjIfv3oGGOkQjmVSTcM8dPj1nmDqiNwu+rIQVu4VESMM8YqqXIK76WjfudGPa4Jg8u7B3APCs4jTzSOlAdS9NNbsJkAms74ABTx+SRkQ==',key_name='tempest-TestNetworkBasicOps-708274738',keypairs=,launch_index=0,launched_at=2026-01-27T00:32:42Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2a0ff21c12df40e98d9a495c23ae7ec5',ramdisk_id='',reservation_id='r-mrali2y6',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestNetworkBasicOps-60627388',owner_user_name='tempest-TestNetworkBasicOps-60627388-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:32:42Z,user_data=None,user_id='ef445dc7773649328d2973e25e8f5176',uuid=05fc4f8b-7d3e-44fe-bc86-fe66d5d094de,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9233f5ce-61fb-446a-aa53-caefe8de23b9", "address": "fa:16:3e:3e:b3:51", "network": {"id": "5e284e07-fd95-4c86-9fe9-f107f2c15155", "bridge": "br-int", "label": "tempest-network-smoke--750310507", "subnets": [{"cidr": "10.1.0.16/28", "dns": [], "gateway": {"address": null, "type": "gateway", "version": null, "meta": {}}, "ips": [{"address": "10.1.0.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0ff21c12df40e98d9a495c23ae7ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9233f5ce-61", "ovs_interfaceid": "9233f5ce-61fb-446a-aa53-caefe8de23b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:33:14.855750 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Converting VIF {"id": "9233f5ce-61fb-446a-aa53-caefe8de23b9", "address": "fa:16:3e:3e:b3:51", "network": {"id": "5e284e07-fd95-4c86-9fe9-f107f2c15155", "bridge": "br-int", "label": "tempest-network-smoke--750310507", "subnets": [{"cidr": "10.1.0.16/28", "dns": [], "gateway": {"address": null, "type": "gateway", "version": null, "meta": {}}, "ips": [{"address": "10.1.0.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0ff21c12df40e98d9a495c23ae7ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9233f5ce-61", "ovs_interfaceid": "9233f5ce-61fb-446a-aa53-caefe8de23b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:33:14.856704 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:b3:51,bridge_name='br-int',has_traffic_filtering=True,id=9233f5ce-61fb-446a-aa53-caefe8de23b9,network=Network(5e284e07-fd95-4c86-9fe9-f107f2c15155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9233f5ce-61') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:33:14.859959 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] attach device xml: Jan 26 19:33:14.859959 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:14.859959 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:14.859959 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:14.859959 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:14.859959 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:14.859959 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:14.859959 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:330}} Jan 26 19:33:14.880232 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:14.894664 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:14.894664 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:15.147923 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e077fde7-7d18-4103-85a6-09a2cd907063 req-bac468f8-dbfa-4805-982e-07913b281ec3 service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Received event network-vif-plugged-9233f5ce-61fb-446a-aa53-caefe8de23b9 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:33:15.147923 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e077fde7-7d18-4103-85a6-09a2cd907063 req-bac468f8-dbfa-4805-982e-07913b281ec3 service nova] Acquiring lock "05fc4f8b-7d3e-44fe-bc86-fe66d5d094de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:33:15.147923 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e077fde7-7d18-4103-85a6-09a2cd907063 req-bac468f8-dbfa-4805-982e-07913b281ec3 service nova] Lock "05fc4f8b-7d3e-44fe-bc86-fe66d5d094de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:33:15.148304 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-e077fde7-7d18-4103-85a6-09a2cd907063 req-bac468f8-dbfa-4805-982e-07913b281ec3 service nova] Lock "05fc4f8b-7d3e-44fe-bc86-fe66d5d094de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:33:15.148460 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-e077fde7-7d18-4103-85a6-09a2cd907063 req-bac468f8-dbfa-4805-982e-07913b281ec3 service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] No waiting events found dispatching network-vif-plugged-9233f5ce-61fb-446a-aa53-caefe8de23b9 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:33:15.148637 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-e077fde7-7d18-4103-85a6-09a2cd907063 req-bac468f8-dbfa-4805-982e-07913b281ec3 service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Received unexpected event network-vif-plugged-9233f5ce-61fb-446a-aa53-caefe8de23b9 for instance with vm_state active and task_state None. Jan 26 19:33:15.184226 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:15.187230 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:15.189973 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:15.192285 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:15.194616 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:16.475210 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] No BDM found with device name vda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:33:16.475658 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] No BDM found with device name hda, not building metadata. {{(pid=189076) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13086}} Jan 26 19:33:16.475658 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] No VIF found with MAC fa:16:3e:f1:4c:15, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:33:16.475758 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] No VIF found with MAC fa:16:3e:3e:b3:51, not building metadata {{(pid=189076) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13062}} Jan 26 19:33:16.981506 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.driver [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='83e5abfe-72a8-4364-96d1-e39a77cf888f', instance_meta=NovaInstanceMeta(name='tempest-TestNetworkBasicOps-server-1971333028', uuid='05fc4f8b-7d3e-44fe-bc86-fe66d5d094de'), owner=OwnerMeta(userid='ef445dc7773649328d2973e25e8f5176', username='tempest-TestNetworkBasicOps-60627388-project-member', projectid='2a0ff21c12df40e98d9a495c23ae7ec5', projectname='tempest-TestNetworkBasicOps-60627388'), image=ImageMeta(id='83e5abfe-72a8-4364-96d1-e39a77cf888f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dc577438-b4a9-446b-8787-a70b8ab24faa", "address": "fa:16:3e:f1:4c:15", "network": {"id": "ea432c68-e894-4375-b92e-812396ec9e92", "bridge": "br-int", "label": "tempest-network-smoke--369171892", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0ff21c12df40e98d9a495c23ae7ec5", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc577438-b4", "ovs_interfaceid": "dc577438-b4a9-446b-8787-a70b8ab24faa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9233f5ce-61fb-446a-aa53-caefe8de23b9", "address": "fa:16:3e:3e:b3:51", "network": {"id": "5e284e07-fd95-4c86-9fe9-f107f2c15155", "bridge": "br-int", "label": "tempest-network-smoke--750310507", "subnets": [{"cidr": "10.1.0.16/28", "dns": [], "gateway": {"address": null, "type": "gateway", "version": null, "meta": {}}, "ips": [{"address": "10.1.0.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0ff21c12df40e98d9a495c23ae7ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9233f5ce-61", "ovs_interfaceid": "9233f5ce-61fb-446a-aa53-caefe8de23b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='32.1.0', creation_time=1769473996.9808924) {{(pid=189076) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] set metadata xml: Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: tempest-TestNetworkBasicOps-server-1971333028 Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:33:16 Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: ide Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: pc Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: tempest-TestNetworkBasicOps-60627388-project-member Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: tempest-TestNetworkBasicOps-60627388 Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:16.982194 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:350}} Jan 26 19:33:17.190251 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-9b9e32ea-45ff-42c4-b8d3-090f9e6ec8a8 req-f1bc45e1-d832-41de-85a9-a72f2615bd01 service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Received event network-vif-plugged-9233f5ce-61fb-446a-aa53-caefe8de23b9 {{(pid=189076) external_instance_event /opt/stack/nova/nova/compute/manager.py:11863}} Jan 26 19:33:17.190603 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-9b9e32ea-45ff-42c4-b8d3-090f9e6ec8a8 req-f1bc45e1-d832-41de-85a9-a72f2615bd01 service nova] Acquiring lock "05fc4f8b-7d3e-44fe-bc86-fe66d5d094de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:33:17.191008 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-9b9e32ea-45ff-42c4-b8d3-090f9e6ec8a8 req-f1bc45e1-d832-41de-85a9-a72f2615bd01 service nova] Lock "05fc4f8b-7d3e-44fe-bc86-fe66d5d094de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:33:17.191332 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [req-9b9e32ea-45ff-42c4-b8d3-090f9e6ec8a8 req-f1bc45e1-d832-41de-85a9-a72f2615bd01 service nova] Lock "05fc4f8b-7d3e-44fe-bc86-fe66d5d094de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:33:17.191562 np0005596550.novalocal nova-compute[189076]: DEBUG nova.compute.manager [req-9b9e32ea-45ff-42c4-b8d3-090f9e6ec8a8 req-f1bc45e1-d832-41de-85a9-a72f2615bd01 service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] No waiting events found dispatching network-vif-plugged-9233f5ce-61fb-446a-aa53-caefe8de23b9 {{(pid=189076) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jan 26 19:33:17.191882 np0005596550.novalocal nova-compute[189076]: WARNING nova.compute.manager [req-9b9e32ea-45ff-42c4-b8d3-090f9e6ec8a8 req-f1bc45e1-d832-41de-85a9-a72f2615bd01 service nova] [instance: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de] Received unexpected event network-vif-plugged-9233f5ce-61fb-446a-aa53-caefe8de23b9 for instance with vm_state active and task_state None. Jan 26 19:33:17.492168 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-211a25b2-bcab-48b5-91a2-fe8049e0410c tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Lock "interface-05fc4f8b-7d3e-44fe-bc86-fe66d5d094de-None" "released" by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" :: held 7.568s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:424}} Jan 26 19:33:18.683666 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:19.841849 np0005596550.novalocal nova-compute[189076]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=189076) __log_wakeup /usr/local/lib/python3.12/site-packages/ovs/poller.py:263}} Jan 26 19:33:20.756021 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ec811de2-9bf2-4986-a449-07c062cad458 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Acquiring lock "interface-05fc4f8b-7d3e-44fe-bc86-fe66d5d094de-9233f5ce-61fb-446a-aa53-caefe8de23b9" by "nova.compute.manager.ComputeManager.detach_interface..do_detach_interface" {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:405}} Jan 26 19:33:20.756545 np0005596550.novalocal nova-compute[189076]: DEBUG oslo_concurrency.lockutils [None req-ec811de2-9bf2-4986-a449-07c062cad458 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Lock "interface-05fc4f8b-7d3e-44fe-bc86-fe66d5d094de-9233f5ce-61fb-446a-aa53-caefe8de23b9" acquired by "nova.compute.manager.ComputeManager.detach_interface..do_detach_interface" :: waited 0.001s {{(pid=189076) inner /usr/local/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:410}} Jan 26 19:33:21.263333 np0005596550.novalocal nova-compute[189076]: DEBUG nova.objects.instance [None req-ec811de2-9bf2-4986-a449-07c062cad458 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Lazy-loading 'flavor' on Instance uuid 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de {{(pid=189076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jan 26 19:33:21.768807 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.vif [None req-ec811de2-9bf2-4986-a449-07c062cad458 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-01-27T00:32:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestNetworkBasicOps-server-1971333028',display_name='tempest-TestNetworkBasicOps-server-1971333028',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0005596550.novalocal',hostname='tempest-testnetworkbasicops-server-1971333028',id=108,image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcxcI3lxhqYhuxbxFviwycODXCjIfv3oGGOkQjmVSTcM8dPj1nmDqiNwu+rIQVu4VESMM8YqqXIK76WjfudGPa4Jg8u7B3APCs4jTzSOlAdS9NNbsJkAms74ABTx+SRkQ==',key_name='tempest-TestNetworkBasicOps-708274738',keypairs=,launch_index=0,launched_at=2026-01-27T00:32:42Z,launched_on='np0005596550.novalocal',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0005596550.novalocal',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='2a0ff21c12df40e98d9a495c23ae7ec5',ramdisk_id='',reservation_id='r-mrali2y6',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='83e5abfe-72a8-4364-96d1-e39a77cf888f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestNetworkBasicOps-60627388',owner_user_name='tempest-TestNetworkBasicOps-60627388-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-01-27T00:32:42Z,user_data=None,user_id='ef445dc7773649328d2973e25e8f5176',uuid=05fc4f8b-7d3e-44fe-bc86-fe66d5d094de,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9233f5ce-61fb-446a-aa53-caefe8de23b9", "address": "fa:16:3e:3e:b3:51", "network": {"id": "5e284e07-fd95-4c86-9fe9-f107f2c15155", "bridge": "br-int", "label": "tempest-network-smoke--750310507", "subnets": [{"cidr": "10.1.0.16/28", "dns": [], "gateway": {"address": null, "type": "gateway", "version": null, "meta": {}}, "ips": [{"address": "10.1.0.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0ff21c12df40e98d9a495c23ae7ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9233f5ce-61", "ovs_interfaceid": "9233f5ce-61fb-446a-aa53-caefe8de23b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=189076) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:574}} Jan 26 19:33:21.769306 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-ec811de2-9bf2-4986-a449-07c062cad458 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Converting VIF {"id": "9233f5ce-61fb-446a-aa53-caefe8de23b9", "address": "fa:16:3e:3e:b3:51", "network": {"id": "5e284e07-fd95-4c86-9fe9-f107f2c15155", "bridge": "br-int", "label": "tempest-network-smoke--750310507", "subnets": [{"cidr": "10.1.0.16/28", "dns": [], "gateway": {"address": null, "type": "gateway", "version": null, "meta": {}}, "ips": [{"address": "10.1.0.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0ff21c12df40e98d9a495c23ae7ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9233f5ce-61", "ovs_interfaceid": "9233f5ce-61fb-446a-aa53-caefe8de23b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jan 26 19:33:21.770592 np0005596550.novalocal nova-compute[189076]: DEBUG nova.network.os_vif_util [None req-ec811de2-9bf2-4986-a449-07c062cad458 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:b3:51,bridge_name='br-int',has_traffic_filtering=True,id=9233f5ce-61fb-446a-aa53-caefe8de23b9,network=Network(5e284e07-fd95-4c86-9fe9-f107f2c15155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9233f5ce-61') {{(pid=189076) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}} Jan 26 19:33:21.774389 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-ec811de2-9bf2-4986-a449-07c062cad458 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] looking for interface given config: {{(pid=189076) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jan 26 19:33:21.776930 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-ec811de2-9bf2-4986-a449-07c062cad458 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] looking for interface given config: {{(pid=189076) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jan 26 19:33:21.779444 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.driver [None req-ec811de2-9bf2-4986-a449-07c062cad458 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] Attempting to detach device tap9233f5ce-61 from instance 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de from the persistent domain config. {{(pid=189076) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2599}} Jan 26 19:33:21.779806 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-ec811de2-9bf2-4986-a449-07c062cad458 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] detach device xml: Jan 26 19:33:21.779806 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.779806 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.779806 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.779806 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.779806 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.779806 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.779806 np0005596550.novalocal nova-compute[189076]: {{(pid=189076) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:460}} Jan 26 19:33:21.813523 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-ec811de2-9bf2-4986-a449-07c062cad458 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] looking for interface given config: {{(pid=189076) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: DEBUG nova.virt.libvirt.guest [None req-ec811de2-9bf2-4986-a449-07c062cad458 tempest-TestNetworkBasicOps-60627388 tempest-TestNetworkBasicOps-60627388-project-member] interface for config: not found in domain: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: instance-0000006c Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: tempest-TestNetworkBasicOps-server-1971333028 Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: 2026-01-27 00:33:16 Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: 192 Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: True Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: bare Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: qcow2 Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: 0 Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: ide Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: pc Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: virtio Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: tempest-TestNetworkBasicOps-60627388-project-member Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: tempest-TestNetworkBasicOps-60627388 Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: 196608 Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: 1 Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: /machine Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: OpenStack Foundation Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: OpenStack Nova Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: 32.1.0 Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: 05fc4f8b-7d3e-44fe-bc86-fe66d5d094de Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Virtual Machine Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: hvm Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: 131072 Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Nehalem Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: destroy Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: restart Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: destroy Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: /usr/libexec/qemu-kvm Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]:
Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.817152 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.822592 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.822592 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.822592 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.822592 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.822592 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.822592 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.822592 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.822592 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.822592 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.822592 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.822592 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.822592 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.822592 np0005596550.novalocal nova-compute[189076]: Jan 26 19:33:21.822592 np0005596550.novalocal nova-compute[189076]: